-- Logs begin at Wed 2021-11-10 15:12:48 UTC, end at Wed 2021-11-10 16:44:37 UTC. -- Nov 10 15:40:15.461972 dv-cinder-817085-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 10 15:40:15.471841 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 10 15:40:15 2021] *** Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: nodename: dv-cinder-817085-2-iscsi Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: machine: x86_64 Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: clock source: unix Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: pcre jit disabled Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: detected number of CPU cores: 4 Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: current working directory: / Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: detected binary path: /usr/bin/uwsgi-core Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: your processes number limit is 47680 Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: your memory page size is 4096 bytes Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: detected max file descriptor number: 2048 Nov 10 15:40:15.473940 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: lock engine: pthread robust mutexes Nov 10 15:40:15.480210 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: thunder lock: enabled Nov 10 15:40:15.480210 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 10 15:40:15.480210 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 10 15:40:15.520353 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: Python main interpreter initialized at 0x5619403039c0 Nov 10 15:40:15.520353 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: python threads support enabled Nov 10 15:40:15.520353 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: your server socket listen backlog is limited to 100 connections Nov 10 15:40:15.520353 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: your mercy for graceful operations on workers is 90 seconds Nov 10 15:40:15.520709 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: mapped 403077 bytes (393 KB) for 2 cores Nov 10 15:40:15.520778 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: *** Operational MODE: preforking *** Nov 10 15:40:15.521054 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: *** uWSGI is running in multiple interpreter mode *** Nov 10 15:40:15.521054 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: spawned uWSGI master process (pid: 79115) Nov 10 15:40:15.521349 dv-cinder-817085-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 10 15:40:15.522486 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: spawned uWSGI worker 1 (pid: 79127, cores: 1) Nov 10 15:40:15.522486 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: spawned uWSGI worker 2 (pid: 79128, cores: 1) Nov 10 15:40:15.522486 dv-cinder-817085-2-iscsi devstack@keystone.service[79115]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 10 15:40:20.713933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:40:20.713933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: from cryptography.utils import int_from_bytes Nov 10 15:40:20.714835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:40:20.714835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: from cryptography.utils import int_from_bytes Nov 10 15:40:20.715289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:40:20.715289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: from cryptography.utils import int_from_bytes Nov 10 15:40:20.715465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 10 15:40:20.715465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: from cryptography.utils import int_from_bytes Nov 10 15:40:20.763263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 15:40:20.763490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 15:40:20.763587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 15:40:20.763688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 15:40:20.763767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] command line args: [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 15:40:20.763846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] command line args: [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 15:40:20.763923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 15:40:20.763999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 15:40:20.764079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ================================================================================ {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 15:40:20.764164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ================================================================================ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 15:40:20.764328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] admin_token = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.764432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] admin_token = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.764590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config_dir = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.764713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] config_dir = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.764800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.764925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] config_source = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] debug = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] config_source = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] debug = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.765957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_config_append = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_config_append = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.766942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_dir = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_dir = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_file = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.767943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.768908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.769946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.770816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] publish_errors = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] publish_errors = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.771958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] standard_threads = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] standard_threads = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.772914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] use_journal = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_journal = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] use_json = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773850 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_json = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.773923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] use_stderr = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.774032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_stderr = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.774121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] use_syslog = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.774222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] use_syslog = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.774300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.774422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 15:40:20.774500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.774571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.774721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.774793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.774866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.774941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.775959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.776898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.777851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.778867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.779877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.780870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.781948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.782996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.783889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.784967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.785926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.786866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.787921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.788955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.789939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.790910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.791990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.792950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.793980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.794920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.795930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796231 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.external = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.796997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.external = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.password = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] auth.token = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.797962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.password = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] auth.token = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.798848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.799851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.800356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.800489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.800601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.800692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.800847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.800925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.801881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.802871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.803917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.804845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.805968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.806945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.807979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.808926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.809985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.810965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.811948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.812931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.813887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.814872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.815954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.816926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.817883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.818992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.819924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.820954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.821931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.822930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.823889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.824866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.825961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.826811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827011 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.827973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.828981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.829915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.830912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] role.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] role.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.831870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.832967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.833945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.834978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.835988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.836960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.837931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.838941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.839918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.840902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.841994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.842112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.842257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.842428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.842597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.842808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.842994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.843965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.connection = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.844948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.845911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.846947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.847026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.847098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.847209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.847284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 15:40:20.847354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.847354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 15:40:20.847598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 15:40:20.878454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.878672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.878814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.878897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.879010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.879172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.887478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.887724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.916338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.916554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.917491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.917741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.971727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:20.972194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.118430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.118693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.121428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.121769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.186558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.186767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.186955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.187773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.188023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.188238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.213395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.213682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.213811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.213950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.214947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.215061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.215179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.226818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.227043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.240954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.241831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 10 15:40:21.259027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.259291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 15:40:21.259452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.259452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 15:40:21.259709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.259709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 15:40:21.259962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.259962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 10 15:40:21.260223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.260358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.260492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.260492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.260741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.260889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.261023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.261023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.271825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.271991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.272128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.272239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.272346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.272451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.272627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.272761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.280711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.281132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.283921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.284184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.284313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.284461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.284572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.284720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.284836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.284999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.285923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.286136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.286297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.286487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.286605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.286742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.286854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.287031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.312949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.313232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.314569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.314953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.315080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.315080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.320114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.320359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.320459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.320635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.320722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.320907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.328739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.328961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.329097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.329221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.333372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.333473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.333616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.333696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.333911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.334963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.335146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.335238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.335410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.335492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.353623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.353765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.353898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.353981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.358602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.358727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.362114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.362281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.362418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.362497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.367348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.367472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.370861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.371004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.374555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.374699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.374834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.374965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.375123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.375274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.375502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.375712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.375846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.375981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.376085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.376178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.394834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.395118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.395242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.395367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.395490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.395612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.395733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.395871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.403437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.403566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.405135 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.405264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.405462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.405565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.408569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.408710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.408846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.408930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.409095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.409298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.409385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.409448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.409680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.409776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.423312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.423495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.423620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.423702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.423829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.423921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.424932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.425337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.442709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.442886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.447425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.447652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.450713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.451939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.452306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.453714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.453922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.454197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.454500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.455336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.455619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.455897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.461651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.463123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.463271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.464690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.466330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.466637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.466889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.467182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.468047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.468433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.468764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.469017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.476229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.476560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.476775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.477982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.478208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.478519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.484764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.485036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.485290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.485555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.485857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.486117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.486405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.486547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 10 15:40:21.486674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.486838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.486964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.487941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.488163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.488291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.488387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.488692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.488962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.489226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.489487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.489745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.489996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 10 15:40:21.525496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619403039c0 pid: 79127 (default app) Nov 10 15:40:21.527312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619403039c0 pid: 79128 (default app) Nov 10 15:40:21.529051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f184-b7d9-4a60-9d69-46d5be2e47d3 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:21.529334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f184-b7d9-4a60-9d69-46d5be2e47d3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:21.529615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f184-b7d9-4a60-9d69-46d5be2e47d3 None None] PATH_INFO: `/v3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:21.534289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Nov 10 15:40:21 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:29.661132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ea67a-a543-461c-a04f-c686ddfc20f7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:29.661686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ea67a-a543-461c-a04f-c686ddfc20f7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:29.661686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ea67a-a543-461c-a04f-c686ddfc20f7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:29.667728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:29 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:40:29.676478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:29.676950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:29.677061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:29.708318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG oslo_db.sqlalchemy.engines [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:40:29.906081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG passlib.handlers.bcrypt [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79127) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 10 15:40:29.906551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG passlib.handlers.bcrypt [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79127) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 10 15:40:29.963549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:29.965122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:30.108050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:30.248959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ea67a-a543-461c-a04f-c686ddfc20f7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:30.284198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG oslo_db.sqlalchemy.engines [None req-3e0ea67a-a543-461c-a04f-c686ddfc20f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 15:40:30.421826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ea67a-a543-461c-a04f-c686ddfc20f7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:30.426992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:30.427671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:30.427954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:30.428231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:30.437347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:30.492953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 10 15:40:30.493313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab61c11-c148-4e0e-a86c-314597c4dfb7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:30.504116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:40:30.511349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:30.526568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77430fc-4d96-4871-8d55-1e65df601593 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:30.532077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:30.533213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:30.533499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:30.533773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] PATH_INFO: `/v3/projects/5257eb1aa0954376ba58fe4f7b901cea` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:30.535562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] RBAC: Authorizing `identity:get_project(project_id=5257eb1aa0954376ba58fe4f7b901cea)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:30.590249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 10 15:40:30.590596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f72a-d95a-48aa-ad4d-78c412e00874 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:30.595989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:30 2021] GET /identity/v3/projects/5257eb1aa0954376ba58fe4f7b901cea => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:32.879006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b60cb-aadf-4d6f-a731-57350ce3c967 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:32.879669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b60cb-aadf-4d6f-a731-57350ce3c967 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:32.879669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b60cb-aadf-4d6f-a731-57350ce3c967 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:32.884558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:32 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:32.891626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:32.892131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:32.892131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:32.912891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:32.914493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:32.923822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:32.950209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b60cb-aadf-4d6f-a731-57350ce3c967 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:32.965876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b60cb-aadf-4d6f-a731-57350ce3c967 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:32.971197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413d905-fae8-44e0-9ac9-4a9d7998e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:32.971851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413d905-fae8-44e0-9ac9-4a9d7998e64f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:32.972132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413d905-fae8-44e0-9ac9-4a9d7998e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:32.972411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413d905-fae8-44e0-9ac9-4a9d7998e64f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:32.980885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413d905-fae8-44e0-9ac9-4a9d7998e64f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:32.982871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413d905-fae8-44e0-9ac9-4a9d7998e64f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:32.992411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:40:33.001061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:33.010859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d246d-0a1b-40d3-a3a2-49521bfd9a4d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:33.016705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003085d5-496a-407f-a316-1039c3bf27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:33.017591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003085d5-496a-407f-a316-1039c3bf27cd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:33.017874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003085d5-496a-407f-a316-1039c3bf27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:33.018152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003085d5-496a-407f-a316-1039c3bf27cd admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:33.019788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003085d5-496a-407f-a316-1039c3bf27cd admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:33.021712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003085d5-496a-407f-a316-1039c3bf27cd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:33.023399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:32 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:35.506844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d82f-ba73-4acb-bebf-f40855ca7efd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.507354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d82f-ba73-4acb-bebf-f40855ca7efd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.507354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d82f-ba73-4acb-bebf-f40855ca7efd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.509065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:35.515755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.516444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.516444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.517922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8476e-746b-4d64-b876-ede00daa492d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.518208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8476e-746b-4d64-b876-ede00daa492d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.518514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8476e-746b-4d64-b876-ede00daa492d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.520239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:35.527199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.527540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.527772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.535134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:35.536339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:35.544107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:40:35.567845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.573349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG passlib.handlers.bcrypt [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79128) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 10 15:40:35.573799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG passlib.handlers.bcrypt [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79128) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 10 15:40:35.577341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569594a-2fbf-4a32-bb4e-c75b3a3bd67f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.581775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.582446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.582732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.583007 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.591602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:35.594607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:35.609823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:40:35.617831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.620649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:35.622346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:35.627778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162166-7387-4f3f-a3c2-c8c808c7c5fe admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.632921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.633726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.634008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.634307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.635577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:35.637350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:35.639060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 8/14] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:40:35.651447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:35.679800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.691414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e612d3-d7c5-4cb2-86ee-f545dc777a9f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.696600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.697452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.697736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.698009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.715455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:35.723025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:40:35.724570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 9/16] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:40:35.731584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.742510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac2b25-0c91-4579-9ec8-96478cf31e99 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.748206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.749853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.750218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.750613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.751719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:35.752120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:35.754066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:35.754066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:40:35.754066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:40:35.755036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:35.774228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 8/17] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:35.781649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.793160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aea07a-a092-4e86-b080-cf9c50c8b788 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.798401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.799301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.799583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.800217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.801476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:35.803416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:35.805429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:35.812880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.824055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd04c-2002-428b-91cc-203e9c38b125 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.831304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07169e-4ab2-4743-92f9-090160da18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.832167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07169e-4ab2-4743-92f9-090160da18bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.832445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07169e-4ab2-4743-92f9-090160da18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.832721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07169e-4ab2-4743-92f9-090160da18bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.834372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07169e-4ab2-4743-92f9-090160da18bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:35.836224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07169e-4ab2-4743-92f9-090160da18bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:35.838251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:35.849238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:35.862722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557427-4199-442c-b8e6-171a72f072e0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:35.869551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:35.870673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:35.871201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:35.871544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:35.872806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.domain.id=default, user.id=0d0f0af1db944cb5ab99675a88ef9fef) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:35.873153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:35.875626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:35.875626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:35.875626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:35.876853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69d95d-4fa7-4c6f-9e42-4d26c0a985a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:35.885224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1343 bytes} [Wed Nov 10 15:40:35 2021] GET /identity/v3/role_assignments?user.id=0d0f0af1db944cb5ab99675a88ef9fef&scope.domain.id=default&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 233 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:39.134929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731916-8eb0-4e84-941c-65c74728d07b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.136576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731916-8eb0-4e84-941c-65c74728d07b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.137354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731916-8eb0-4e84-941c-65c74728d07b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.143691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:39 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:39.153090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.154790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.155643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.199848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:39.202574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:39.226035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 12/22] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:39.262696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731916-8eb0-4e84-941c-65c74728d07b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.291537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731916-8eb0-4e84-941c-65c74728d07b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.305361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.307496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.308313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.309112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.336309 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:39.343615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:40:39.345300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 11/23] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:40:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:39.352343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.379078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e528fe-2b50-4037-bdee-c6f6e682432e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.403491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.405214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.406029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.406850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.408678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:39.409557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:39.411878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:39.411878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:39.411878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:39.414300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16fddb-f6f3-4e5f-92f6-062bc3023360 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:39.451298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 13/24] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:39.460320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.485436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b33b8-235f-4c96-8f1f-20490bba18c6 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.486426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b33b8-235f-4c96-8f1f-20490bba18c6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.487039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c726c2-dbe9-429c-9d64-e061ba11c804 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.487446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b33b8-235f-4c96-8f1f-20490bba18c6 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.500364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 14/25] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:39 2021] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:40:39.501386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.503001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.503508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.504007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.506741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:39.513398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.514341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:39.514748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.515489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.517905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 12/26] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:39 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:39.530220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.551766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720d6b3-8fce-4452-ac8f-07f90413b3aa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.564853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.566183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.566671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.567163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.569233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:39.576715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:39.577631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:39.579430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:39.585641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 13/27] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:39.587555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.607188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 15/28] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:40:39.612140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd7f0d-b89f-4b3c-8fc4-0f503a2c366c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.629371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.631062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.631565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.632076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] PATH_INFO: `/v3/domains/default/users/0d0f0af1db944cb5ab99675a88ef9fef/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.636290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0d0f0af1db944cb5ab99675a88ef9fef, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:39.640830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:39.640830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:40:39.640830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:40:39.645065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e7aa9-9b0c-48fd-95e3-7aab27f20a22 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:39.658926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.684738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef74df3-a9f6-4de6-ae64-5181760f1311 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.817876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.819380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.821984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.824879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.845390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:39.848953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:39.883423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-60c95a43-98c2-45af-885f-26c94508233a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:40:39.885562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 16/29] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:39.887878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e4cc-d799-4b39-923b-fa9e2cae5ef6 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.888357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e4cc-d799-4b39-923b-fa9e2cae5ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.888923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e4cc-d799-4b39-923b-fa9e2cae5ef6 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.892961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 17/30] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:39.893887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 14/31] 10.222.0.60 () {58 vars in 1382 bytes} [Wed Nov 10 15:40:39 2021] PUT /identity/v3/domains/default/users/0d0f0af1db944cb5ab99675a88ef9fef/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:40:39.895782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59e4cc-d799-4b39-923b-fa9e2cae5ef6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:39.901286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.907005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.907483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.939260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59e4cc-d799-4b39-923b-fa9e2cae5ef6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:39.956866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:39.958649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:39.962479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:39.963333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:39.968169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:39.969205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:39.972225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:39.972225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:39.972225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:39.979671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:39.986325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:39.989791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:40.022482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 15/32] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:40:40.037026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 18/33] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:40:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:40.046322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:40.058200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:40.074378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e744d-5dbb-4548-b3fa-b4bf690a1c2c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:40.079474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90ac5-72f1-4fa8-8817-210f2427f187 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:40.089725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:40.090443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.090730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.091004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.091778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:40.093196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:40.093196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:40:40.093196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:40:40.094513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b0ad1-3015-4acd-b459-5a8188587fa0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:40.098639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:40.099400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.099686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.099963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.100789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:40.101842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:40.101842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:40.101842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:40.102825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b898-4cbe-4d06-ab4a-36570d9e572e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:40.200477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 16/34] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/projects => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:40:40.291772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 19/35] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/roles => generated 223 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:40:40.707475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff33da-4dcd-469e-a3c2-9d64373a10b3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.707944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff33da-4dcd-469e-a3c2-9d64373a10b3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.708077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff33da-4dcd-469e-a3c2-9d64373a10b3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.710371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 17/36] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:40.720454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb12a99-be64-4835-93e7-e20368d161cb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.720839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb12a99-be64-4835-93e7-e20368d161cb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.721068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb12a99-be64-4835-93e7-e20368d161cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.747549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-deb12a99-be64-4835-93e7-e20368d161cb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:40.749450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-deb12a99-be64-4835-93e7-e20368d161cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:40.829264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 20/37] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:40.858458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e1834-1dfa-48fd-807a-41424aeeb60a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.858883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e1834-1dfa-48fd-807a-41424aeeb60a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.859123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e1834-1dfa-48fd-807a-41424aeeb60a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.861506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 18/38] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:40.871267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a10c8-d2aa-41fd-ac3e-994186fbb310 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.871547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a10c8-d2aa-41fd-ac3e-994186fbb310 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.871845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a10c8-d2aa-41fd-ac3e-994186fbb310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.888174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e1834-1dfa-48fd-807a-41424aeeb60a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:40.903332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-814a10c8-d2aa-41fd-ac3e-994186fbb310 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:40.904787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-814a10c8-d2aa-41fd-ac3e-994186fbb310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:40.911255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e1834-1dfa-48fd-807a-41424aeeb60a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:40.918996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 21/39] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:40.920492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:40.921258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.921538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.921905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.922824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:40.923974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:40.923974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:40:40.923974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:40:40.925310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:40.926352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa8c6-8178-4b7d-bc44-9aa66536dd55 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.926818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa8c6-8178-4b7d-bc44-9aa66536dd55 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.927107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa8c6-8178-4b7d-bc44-9aa66536dd55 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.929486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 22/40] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:40 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:40.939842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.940984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.944045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.955528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 19/41] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/roles => generated 219 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:40:40.962491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:40.974052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a79f63-b723-417a-832b-63d521ab39cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:40.982240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:40.983680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:40.984141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:40.984622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:40.985851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:40.989028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:40.989698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:40.992412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:41.008729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 23/42] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:41.015957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 20/43] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:40:40 2021] POST /identity/v3/roles => generated 225 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:40:41.052480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:41.070689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b0048-b3fa-4266-bd24-3b557d498f68 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:41.078462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5657-00a6-4272-8259-f07e9c3b1a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:41.080124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5657-00a6-4272-8259-f07e9c3b1a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:41.080908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5657-00a6-4272-8259-f07e9c3b1a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:41.081702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5657-00a6-4272-8259-f07e9c3b1a53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:41.084417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f5657-00a6-4272-8259-f07e9c3b1a53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:41.088419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f5657-00a6-4272-8259-f07e9c3b1a53 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:41.092140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 24/44] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:41.105253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:41.123622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ceade-4792-4b63-a157-3c5d886a06a6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:41.131979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d073e51-1679-4702-8529-e2aba9939ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:41.133431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073e51-1679-4702-8529-e2aba9939ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:41.134096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073e51-1679-4702-8529-e2aba9939ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:41.134910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d073e51-1679-4702-8529-e2aba9939ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:41.136475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d073e51-1679-4702-8529-e2aba9939ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:41.140701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d073e51-1679-4702-8529-e2aba9939ca3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:41.190463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 21/45] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:40:41 2021] POST /identity/v3/projects => generated 312 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:40:42.991685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f12c1-2ddc-462d-afdb-3abba63ebd01 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:42.992410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f12c1-2ddc-462d-afdb-3abba63ebd01 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:42.992649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f12c1-2ddc-462d-afdb-3abba63ebd01 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:42.996028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 25/46] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:42 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:43.004354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.004981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.005394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.036300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:43.038466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:43.140494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 22/47] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:43.168807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f12c1-2ddc-462d-afdb-3abba63ebd01 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.185625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f12c1-2ddc-462d-afdb-3abba63ebd01 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.190782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.191589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.191868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.192141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.204791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:43.213805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:40:43.217180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 26/48] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:40:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:43.222817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.232287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46154c85-988c-4ce2-a5d0-c0a644ebab82 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.237001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.237678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.237964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.238281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.239090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:43.239400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:43.241100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:43.261008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 23/49] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:43.262629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.273878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c95a7-dea8-41cf-9a07-7517db174c98 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.278614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.279621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.279855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.280576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.281388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:43.283307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:43.284973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 27/50] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:43 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:43.291544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.303213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea053b7-ab7b-4677-bafa-978cf583034a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.308326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b3dad-fd4e-4655-91c0-e3ea7dd096a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.309285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b3dad-fd4e-4655-91c0-e3ea7dd096a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.309667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b3dad-fd4e-4655-91c0-e3ea7dd096a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.310029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b3dad-fd4e-4655-91c0-e3ea7dd096a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.311507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b3dad-fd4e-4655-91c0-e3ea7dd096a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:43.313435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b3dad-fd4e-4655-91c0-e3ea7dd096a5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:43.315173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 24/51] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:43.322548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.332864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd3bea-64fd-4dfc-8464-a4f0d5bf47b7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.337694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.338378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.338662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.338936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.339788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.domain.id=default, user.id=0d0f0af1db944cb5ab99675a88ef9fef) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:43.340088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:43.342150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439091c-0354-4896-b078-446a6b4ecb20 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:43.348972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 28/52] 10.222.0.60 () {56 vars in 1343 bytes} [Wed Nov 10 15:40:43 2021] GET /identity/v3/role_assignments?user.id=0d0f0af1db944cb5ab99675a88ef9fef&scope.domain.id=default&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:43.606037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf730e-3321-4b7b-88b2-dcc6e8a84206 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.606324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf730e-3321-4b7b-88b2-dcc6e8a84206 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.606560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf730e-3321-4b7b-88b2-dcc6e8a84206 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.608769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 25/53] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:43.615415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.615706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.615989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.636703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:43.637972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:43.647729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 29/54] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:43.673967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf730e-3321-4b7b-88b2-dcc6e8a84206 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.687796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf730e-3321-4b7b-88b2-dcc6e8a84206 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.692689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef82dd5-276c-4e40-b2e6-94ea58e74bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.693600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82dd5-276c-4e40-b2e6-94ea58e74bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.693905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82dd5-276c-4e40-b2e6-94ea58e74bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.694148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82dd5-276c-4e40-b2e6-94ea58e74bb7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.695595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef82dd5-276c-4e40-b2e6-94ea58e74bb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:43.697318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef82dd5-276c-4e40-b2e6-94ea58e74bb7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:43.698976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 26/55] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:43.705746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:43.715398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb31e-e2e8-4b65-9da7-0cfdbb2d333b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:43.720810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:43.721498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:43.721781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:43.722059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:43.722858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:43.723907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:43.723907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:43.723907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:43.725392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f3bf-dd54-4112-9ecb-bec48b7d83be admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:43.755637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 30/56] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Nov 10 15:40:43 2021] POST /identity/v3/projects => generated 298 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:40:46.062079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705c8a-fd66-4d7b-a3a3-3f1e71a8fa87 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:46.062691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705c8a-fd66-4d7b-a3a3-3f1e71a8fa87 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:46.062691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705c8a-fd66-4d7b-a3a3-3f1e71a8fa87 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:46.064449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 27/57] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:46.071117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:46.071617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:46.071704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:46.091568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:46.093028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:46.159699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 31/58] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:46.188816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705c8a-fd66-4d7b-a3a3-3f1e71a8fa87 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:46.203241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705c8a-fd66-4d7b-a3a3-3f1e71a8fa87 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:46.208150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3dda-b614-4b53-ac62-ad942e7ad4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:46.208956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3dda-b614-4b53-ac62-ad942e7ad4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:46.209240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3dda-b614-4b53-ac62-ad942e7ad4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:46.209518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3dda-b614-4b53-ac62-ad942e7ad4d8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:46.210838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3dda-b614-4b53-ac62-ad942e7ad4d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:46.212582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3dda-b614-4b53-ac62-ad942e7ad4d8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:46.214261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 28/59] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:46.221275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:46.231449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca9c7e-8688-48d5-ae07-50ce9f7ee05e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:46.236621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:46.237307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:46.237587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:46.237856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:46.238641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:46.239689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:46.239689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:46.239689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:46.240963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd396eb7-e8fe-4ec8-b347-9d00a98532d2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:46.269217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 32/60] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:40:46 2021] POST /identity/v3/users => generated 275 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:40:50.820585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8bdd-0009-4ce6-9ec3-ce0113e29107 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:50.821202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8bdd-0009-4ce6-9ec3-ce0113e29107 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:50.821594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8bdd-0009-4ce6-9ec3-ce0113e29107 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:50.825158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 29/61] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:50 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:40:50.845679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:50.846266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:50.846737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:50.893949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:50.896242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:50.917040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 33/62] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:50.992357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd45d6-b587-42a5-8666-7e7f3a9f0277 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:50.993339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd45d6-b587-42a5-8666-7e7f3a9f0277 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:50.994132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd45d6-b587-42a5-8666-7e7f3a9f0277 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:50.995811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:50.997963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 30/63] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:50 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:40:51.016274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8c15-3bc9-470d-ac5b-b7e889740ee4 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.017222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8c15-3bc9-470d-ac5b-b7e889740ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.017658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fde4a-90fc-4176-9710-8d36d733e92a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.018458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8c15-3bc9-470d-ac5b-b7e889740ee4 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.022920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:51 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:40:51.030262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.030262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.030262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.030788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de383-4838-4c39-b18f-c8e202704ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.030957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de383-4838-4c39-b18f-c8e202704ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.031380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de383-4838-4c39-b18f-c8e202704ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.031786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de383-4838-4c39-b18f-c8e202704ac4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.050674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284de383-4838-4c39-b18f-c8e202704ac4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:51.053951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:51.055954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:51.064010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-284de383-4838-4c39-b18f-c8e202704ac4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:40:51.070313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 34/65] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:51.070313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9687-81a8-41e5-a2c2-a99cad1d4c6c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.070313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9687-81a8-41e5-a2c2-a99cad1d4c6c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.070313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9687-81a8-41e5-a2c2-a99cad1d4c6c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.070973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 35/66] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:51.072611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96d07a-2dfd-4572-b464-f1e595c0f433 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.073088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96d07a-2dfd-4572-b464-f1e595c0f433 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.073562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96d07a-2dfd-4572-b464-f1e595c0f433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.074592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 32/67] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:51.076376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.103575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c835fc-7fe8-452a-b2b7-b612670fdbaf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.107933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-6c96d07a-2dfd-4572-b464-f1e595c0f433 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:51.109430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6c96d07a-2dfd-4572-b464-f1e595c0f433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:51.112518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.113764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.114846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.114846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.116286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.116852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.120194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.127617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:51.131132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.131987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.132515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.137366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 33/69] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.138893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.158394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906586f-c5ab-40f0-b457-0db1778ce3d9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.165344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:51.166586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.167456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:51.167982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.168504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.169014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.183304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 37/70] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:51.185183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.192734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:51.202441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57973c86-0c5c-43ac-8479-d5ebceb6c8ef None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.208331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:40:51.209805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.211407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 34/71] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:51.213067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.219736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.219925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.220461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.233074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f0b86-80f3-40cc-84a7-e20d07249bfa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.244492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.244492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.244492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.244492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.253160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.255569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.267003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 38/72] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.267003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.274598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:51.277628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225dd09-a6ea-4e53-9896-956c69e36877 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.282735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.283651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.283942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.284226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.286882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:40:51.290843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 35/73] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:51.290843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.306345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:51.307995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c9f52-ea0b-442e-bc52-545e1512a88d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.313656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:40:51.314993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 39/74] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:51.315821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.316815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.318109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.318797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.320070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.322514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.323110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.328027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.333370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c4d5-8590-4c13-af4b-534cf8e7bb94 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.342859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.343789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.344204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.344599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.347761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 36/75] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.349051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.357715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.359626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.368520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b017611-b3b4-466e-9f1f-7e470f8a64c7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.373562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.373801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 40/76] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:40:51.374751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.375616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.376450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.377266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.379136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.379697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.383004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.385417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903e079-0f2c-476f-9222-54e654a761cd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.393377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.394724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.395027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.395331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.396182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.396515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.398119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.399248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 37/77] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.404797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.414098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 41/78] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.415021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.422930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df577dc3-5755-4200-b6f0-033c168680ad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.426188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc743ff-9505-4b46-b98e-12c49abbb4d6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.429805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.430930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.431105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.431499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.431838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.431959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.432162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.432377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.433724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.435002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.436295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.437159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.446588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 38/79] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.446775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 42/80] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.446848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.446930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.458001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419b01-7a00-4dd7-a69a-428386bcb185 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.464699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.465863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.466329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.466765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.468850 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.470541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324aff-d055-43b6-8102-e8d6ffbdc4c7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.472291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.475955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 39/81] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.476193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.482561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.483715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.484069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.484435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.486138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.488400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.490143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 43/82] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.490512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331504-db6c-4634-abb3-b96d7eebadeb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.490987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.496748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.497825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.498521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.499712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.505815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5e85-dbcc-4ec8-8c6c-534ef0271468 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.511074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.511397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.512133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.512465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.512802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.513633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.513955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=6d553deefeab49daaeb29401ad6f9a26, user.id=6f6e729c07b0473793742efdbd331d64) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.514522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.516462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ab32d-ffcb-4e07-930b-63e74e648b4c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.523838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 44/83] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/role_assignments?user.id=6f6e729c07b0473793742efdbd331d64&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.537332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 40/84] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:40:51.537332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.537714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcbc3b-a0cb-4f67-9872-4917c77c1dc8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.537714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcbc3b-a0cb-4f67-9872-4917c77c1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.537714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcbc3b-a0cb-4f67-9872-4917c77c1dc8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.537714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 45/85] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:51.537714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcbc3b-a0cb-4f67-9872-4917c77c1dc8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.544884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718051b3-5a56-42c4-9c3c-d76ef295c8bc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.547952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcbc3b-a0cb-4f67-9872-4917c77c1dc8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.550224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.551032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.551328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.551607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.554618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b06b0-34f7-44a7-8503-0b673c75b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.555707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b06b0-34f7-44a7-8503-0b673c75b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.556041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b06b0-34f7-44a7-8503-0b673c75b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.556444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b06b0-34f7-44a7-8503-0b673c75b2bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.560810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.562718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.568732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b06b0-34f7-44a7-8503-0b673c75b2bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.570722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b06b0-34f7-44a7-8503-0b673c75b2bb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.573957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 41/86] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:40:51.574698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.587395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366824-79ff-4ca6-961b-be6d67fcf326 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.588202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 46/87] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:40:51.589641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.589886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.590220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.592729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.593901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.594257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.594501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.596059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.598331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.606416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 42/88] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.606416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.612347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28da938-a094-4a64-9f2f-37575cb2c825 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.617474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.618400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.618794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.619074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] PATH_INFO: `/v3/projects/43295c5b258041acb98f3fb32ccaba4d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.620560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] RBAC: Authorizing `identity:get_project(project_id=43295c5b258041acb98f3fb32ccaba4d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.623061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.624461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:51.625029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 43/89] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/projects/43295c5b258041acb98f3fb32ccaba4d => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.625878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.627415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:51.636950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef80176-8e2d-4615-ac12-0a6cfa87998d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.642205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 47/90] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:51.644073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.644828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.646629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.647260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.647849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.650441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.655149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.660122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 44/91] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.661844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.662919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa7d5e-3406-4563-88bc-34bfd0b1c0f3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.670832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.671828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.672275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.672725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.673968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] RBAC: Adding query filter params (role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=6d553deefeab49daaeb29401ad6f9a26, user.id=6f6e729c07b0473793742efdbd331d64) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.674827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.678321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.680265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24692932-9e4f-49ac-9607-f9e6a5ae2c8e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.688078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.688505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 48/92] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/role_assignments?user.id=6f6e729c07b0473793742efdbd331d64&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=562e684ed61e49f89bb4094923724b9b => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.689971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.695015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.695772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.696345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.697568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=43295c5b258041acb98f3fb32ccaba4d, user.id=6f6e729c07b0473793742efdbd331d64) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.698601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.701102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:51.701102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:40:51.701102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:40:51.704092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.706615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07d992-ff30-498e-a108-e7d5d67d2a1b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.714264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.715361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.715859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.716275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.717007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 45/93] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/role_assignments?user.id=6f6e729c07b0473793742efdbd331d64&scope.project.id=43295c5b258041acb98f3fb32ccaba4d&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.717947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=6d553deefeab49daaeb29401ad6f9a26, user.id=0d0f0af1db944cb5ab99675a88ef9fef) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:51.718674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.719351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.722590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.733897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 49/94] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/role_assignments?user.id=0d0f0af1db944cb5ab99675a88ef9fef&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.734914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339056-70d9-4d50-8e18-c930508a4938 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.744647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910dea-1c8f-453a-8942-9a08e9861830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.745789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910dea-1c8f-453a-8942-9a08e9861830 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.746121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910dea-1c8f-453a-8942-9a08e9861830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.746616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910dea-1c8f-453a-8942-9a08e9861830 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.749398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910dea-1c8f-453a-8942-9a08e9861830 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.751553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910dea-1c8f-453a-8942-9a08e9861830 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.754038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 46/95] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:51.761779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:51.778567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fe731-41a4-4219-84d4-e875311dec8e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:51.786370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ddb67-38f2-40d2-b208-7136ba1ff193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:51.787894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ddb67-38f2-40d2-b208-7136ba1ff193 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:51.788519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ddb67-38f2-40d2-b208-7136ba1ff193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:51.789075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ddb67-38f2-40d2-b208-7136ba1ff193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:51.790773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ddb67-38f2-40d2-b208-7136ba1ff193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:51.794575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ddb67-38f2-40d2-b208-7136ba1ff193 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:51.837754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 50/96] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:40:51 2021] POST /identity/v3/projects => generated 302 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:40:55.338588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0957-d3b4-407c-8694-b4a2078ef7bb None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.339342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0957-d3b4-407c-8694-b4a2078ef7bb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.339690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0957-d3b4-407c-8694-b4a2078ef7bb None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.343455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 47/97] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:55.365621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.366778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.366778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.373366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcccf5-08db-4ebd-adb8-0dff430a653a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.373792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcccf5-08db-4ebd-adb8-0dff430a653a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.373946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcccf5-08db-4ebd-adb8-0dff430a653a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.375819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 48/98] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:55.382357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de470-6200-49ca-9333-f88120a4cbae None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.382723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de470-6200-49ca-9333-f88120a4cbae None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.382990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de470-6200-49ca-9333-f88120a4cbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.402988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-480de470-6200-49ca-9333-f88120a4cbae None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:55.403466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:55.404313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-480de470-6200-49ca-9333-f88120a4cbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:55.404754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:55.495021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 49/99] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:40:55.496174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b78f-a5c3-4f1a-8cdd-0fe6176194e7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.496457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b78f-a5c3-4f1a-8cdd-0fe6176194e7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.496774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b78f-a5c3-4f1a-8cdd-0fe6176194e7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.501235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 50/100] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:55.523365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.523754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.523989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.547632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:55.550789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:55.556994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:55.557616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.573895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35760d-5318-4715-906f-3b35351bf831 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.574862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 51/102] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:40:55.579085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.579989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.580291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.580587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.594588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:55.601954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:40:55.603830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 52/103] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:55.611342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.621952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd14ea-f570-4c6a-8c0d-da4c6c3edd96 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.627448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.628187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.628476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.628761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.629592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:55.629906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.631694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.643282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 52/104] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:40:55.651236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.655970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.662232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f3f6-ce94-47dd-b01b-3ce6d7c0307d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.667603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.669075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.669565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.670322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.676256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383e65-1f7e-48f0-b657-919899f4c4a2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.684291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200eac-7d25-4b9b-a6b2-547e98fb03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.684736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:55.686878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200eac-7d25-4b9b-a6b2-547e98fb03d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.687690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200eac-7d25-4b9b-a6b2-547e98fb03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.688514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200eac-7d25-4b9b-a6b2-547e98fb03d9 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.691138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51200eac-7d25-4b9b-a6b2-547e98fb03d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.692569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:40:55.694215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 53/105] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:40:55.694827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.697025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51200eac-7d25-4b9b-a6b2-547e98fb03d9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.701634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 53/106] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:55.703997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8067-0231-41cc-8e7a-1aba1aeb98b8 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.704501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8067-0231-41cc-8e7a-1aba1aeb98b8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.704998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8067-0231-41cc-8e7a-1aba1aeb98b8 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.707473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0c678-4fcb-4f9f-bcba-7c9843ebd4f2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.708813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 54/107] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:55.710150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8067-0231-41cc-8e7a-1aba1aeb98b8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.712829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6925a-190c-4641-b329-61e5bea624ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.713674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6925a-190c-4641-b329-61e5bea624ac admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.713966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6925a-190c-4641-b329-61e5bea624ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.714289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6925a-190c-4641-b329-61e5bea624ac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.726895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8067-0231-41cc-8e7a-1aba1aeb98b8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.733474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.733474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.733474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.733474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.734231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:55.734507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.736401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.746334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6925a-190c-4641-b329-61e5bea624ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:55.749012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 55/108] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:55.749927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.762080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-9ab6925a-190c-4641-b329-61e5bea624ac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:40:55.763413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef440d-4ece-4b02-a9e9-72638bc0ea7b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.764555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 54/109] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:55.766542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.766839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.767124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.774535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.776444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.776444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.776444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] PATH_INFO: `/v3/projects/43295c5b258041acb98f3fb32ccaba4d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.777707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] RBAC: Authorizing `identity:get_project(project_id=43295c5b258041acb98f3fb32ccaba4d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.780271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.782403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 56/110] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/projects/43295c5b258041acb98f3fb32ccaba4d => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:55.783254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.793743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de48eeb-c22c-476e-82be-37b0a542f2ea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.796082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:55.798061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:55.798934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.800152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.800439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.800723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.802032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.804502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.806295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 57/111] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:55.807100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.817492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 55/112] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:55.822479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c92893-fd4f-4562-81eb-fcbdcaa8c937 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.822586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.828993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.829859 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.830314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.830798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.832278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:55.832842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.836595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.836794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4bd00-b58d-4b60-9426-663c67c59b7a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.845359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.846962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.848278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.848785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] PATH_INFO: `/v3/projects/43295c5b258041acb98f3fb32ccaba4d/users/6f6e729c07b0473793742efdbd331d64/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.852726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 58/113] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:55.853337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43295c5b258041acb98f3fb32ccaba4d, user_id=6f6e729c07b0473793742efdbd331d64, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.854568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.855346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:40:55.855346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:40:55.855346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:40:55.859522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.865313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cd15-40e7-43c6-82ed-b6317eb4a2c3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.870380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9550ad-adff-4db8-aed7-570c72383322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.871285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9550ad-adff-4db8-aed7-570c72383322 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.871570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9550ad-adff-4db8-aed7-570c72383322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.871854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9550ad-adff-4db8-aed7-570c72383322 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.873200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9550ad-adff-4db8-aed7-570c72383322 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:55.875441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9550ad-adff-4db8-aed7-570c72383322 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:55.877337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 59/114] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:55.878678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfa15f-c8a8-4fe5-a3bb-804036d78bf3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.879047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfa15f-c8a8-4fe5-a3bb-804036d78bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.879283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfa15f-c8a8-4fe5-a3bb-804036d78bf3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.881345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 60/115] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:40:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:40:55.881754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfa15f-c8a8-4fe5-a3bb-804036d78bf3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.895699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 56/116] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:40:55 2021] PUT /identity/v3/projects/43295c5b258041acb98f3fb32ccaba4d/users/6f6e729c07b0473793742efdbd331d64/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:40:55.895699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:55.983012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfa15f-c8a8-4fe5-a3bb-804036d78bf3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:55.990780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ffb4-c3ef-414f-9606-f1c6259a6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:55.992230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ffb4-c3ef-414f-9606-f1c6259a6cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:55.992706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ffb4-c3ef-414f-9606-f1c6259a6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:55.993174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ffb4-c3ef-414f-9606-f1c6259a6cb6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:55.994470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55852137-22cc-453f-8669-1444bf6fb498 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.000188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.001214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.001568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.001932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.003457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.006099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.008173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 57/117] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:56.011850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.019399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755ffb4-c3ef-414f-9606-f1c6259a6cb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:40:56.026338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c3f6b-0a54-4be2-adab-1b5903bca4a7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.031954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.033109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.033560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6755ffb4-c3ef-414f-9606-f1c6259a6cb6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:40:56.033735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.034053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26/users/6f6e729c07b0473793742efdbd331d64/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.035930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 61/118] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:40:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:40:56.037329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d553deefeab49daaeb29401ad6f9a26, user_id=6f6e729c07b0473793742efdbd331d64, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.042333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.042333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.042333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.042767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.066686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 58/119] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:40:56 2021] PUT /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26/users/6f6e729c07b0473793742efdbd331d64/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:40:56.068193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.073263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:40:56.075575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:40:56.205944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191585-199b-4564-999d-4513652a3b18 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.207852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 62/120] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:40:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:40:56.209508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.223456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.225301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.225943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.226618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.227611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c093bf-01d9-4610-9a01-ba5fd6104d88 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.235685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.235933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.237055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.237526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.238043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.239430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:40:56.239924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.241325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.243007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.244780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 59/121] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:56 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:56.259799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 63/122] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:40:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:56.272226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.273829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.290759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff354-cb3e-4cea-a1c5-ca961750c084 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.296081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba78b3-6b48-499b-a733-c53b6a9f1ff5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.298609 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.300461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.300903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.301330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.303675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.305559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.306928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.307698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.308414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.309129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26/users/6f6e729c07b0473793742efdbd331d64/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.309889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 64/123] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:40:56 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:40:56.311672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.314112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d553deefeab49daaeb29401ad6f9a26, user_id=6f6e729c07b0473793742efdbd331d64, role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.319853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.329428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b53d-ec9d-423f-a8c1-dac3000dfdf8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.337014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.338368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.338826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.339738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.341579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.344803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.347719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 65/124] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:40:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:56.354201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.355972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 60/125] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:40:56 2021] PUT /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26/users/6f6e729c07b0473793742efdbd331d64/roles/562e684ed61e49f89bb4094923724b9b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:40:56.362382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.366374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9581f-48c9-493c-a2c4-a120714b8ded admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.465718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.467792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.467792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.468117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.470307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.473758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.479284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 66/126] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:40:56 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:40:56.488458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:40:56.494669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf18c1b-91c7-4e92-be7c-4663b128f7a4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.514421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664f91-1cbb-428f-9d13-9a9218abd1e4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:40:56.516696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af8d38-7677-419a-9084-2862a58a69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.517493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af8d38-7677-419a-9084-2862a58a69f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.517776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af8d38-7677-419a-9084-2862a58a69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.518077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af8d38-7677-419a-9084-2862a58a69f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.519099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af8d38-7677-419a-9084-2862a58a69f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.523599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af8d38-7677-419a-9084-2862a58a69f3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.524615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db83509-5437-4fcb-b08e-71aa52a5a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:40:56.526528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83509-5437-4fcb-b08e-71aa52a5a9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:40:56.527307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83509-5437-4fcb-b08e-71aa52a5a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:40:56.528033 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83509-5437-4fcb-b08e-71aa52a5a9cc admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26/users/0d0f0af1db944cb5ab99675a88ef9fef/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:40:56.531864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db83509-5437-4fcb-b08e-71aa52a5a9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d553deefeab49daaeb29401ad6f9a26, user_id=0d0f0af1db944cb5ab99675a88ef9fef, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:40:56.539140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db83509-5437-4fcb-b08e-71aa52a5a9cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:40:56.565205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 61/127] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:40:56 2021] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:40:56.565902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 67/128] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:40:56 2021] PUT /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26/users/0d0f0af1db944cb5ab99675a88ef9fef/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:00.302050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623654-cad5-476b-8922-f4869aedea70 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.302917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623654-cad5-476b-8922-f4869aedea70 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.303049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623654-cad5-476b-8922-f4869aedea70 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.310876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 62/129] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:00 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:00.318457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.319267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.319400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.358418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:00.360427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:00.485990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 68/130] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:00.533212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623654-cad5-476b-8922-f4869aedea70 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:00.559432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623654-cad5-476b-8922-f4869aedea70 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:00.568089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:00.569527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.570024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.570537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.598139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:00.611852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:00.618344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 63/131] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:00.621913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:00.643177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf0fa-26c9-44ea-b9a1-c3187f42c0c0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:00.657236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:00.658383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.658885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.659388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.660846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:00.661392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:00.664515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:00.684863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 69/132] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:00.693319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:00.716459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc38d5-2be8-4012-af87-94d21e75daa4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:00.727753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:00.729338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.729823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.730339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.735674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:00.739988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:00.743762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 64/133] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:00 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:00.751437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:00.775413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a15f-f74b-4539-b760-9a8021d0d93b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:00.789580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:00.790792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.791297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.791785 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.813062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:00.816965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:00.841061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 70/134] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:00.851154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:00.876558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabea872-afb0-459e-872c-6f446bc31864 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:00.884632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96a01-fefd-493a-a197-82c60e52878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:00.886274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96a01-fefd-493a-a197-82c60e52878e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.886799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96a01-fefd-493a-a197-82c60e52878e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.887296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96a01-fefd-493a-a197-82c60e52878e admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.890435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96a01-fefd-493a-a197-82c60e52878e admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:00.894577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96a01-fefd-493a-a197-82c60e52878e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:00.898464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 65/135] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:00 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:00.908034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:00.925545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c492e7-fa71-4b68-b79e-f57e0641601a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:00.937592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:00.938873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:00.939351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:00.939832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:00.946370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=6d553deefeab49daaeb29401ad6f9a26, user.id=6f6e729c07b0473793742efdbd331d64) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:00.947276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:00.951319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9ebd-3713-41b9-9292-e67bdec42c13 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:00.960161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 71/136] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:00 2021] GET /identity/v3/role_assignments?user.id=6f6e729c07b0473793742efdbd331d64&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:01.296685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e357-824f-4bb7-8324-156cd1acb26e None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.297111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e357-824f-4bb7-8324-156cd1acb26e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.297492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e357-824f-4bb7-8324-156cd1acb26e None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.301228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 66/137] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:01.308912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cb256-aab8-4549-93d8-252ec922b8c4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.309365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cb256-aab8-4549-93d8-252ec922b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.309603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cb256-aab8-4549-93d8-252ec922b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.343285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7c8cb256-aab8-4549-93d8-252ec922b8c4 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:01.344887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7c8cb256-aab8-4549-93d8-252ec922b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:01.358439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 72/138] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:01.396409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6046a-1014-4ef2-b313-48322863a486 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.397301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6046a-1014-4ef2-b313-48322863a486 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.397301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6046a-1014-4ef2-b313-48322863a486 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.399168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 67/139] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:01.406001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.406459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.406689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.416849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6046a-1014-4ef2-b313-48322863a486 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.442100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6046a-1014-4ef2-b313-48322863a486 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.451014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.451881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.452172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.452457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.454212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:01.455460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:01.473860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 73/140] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:01.474540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:01.483881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:01.485380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 68/141] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:01.492938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.504891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06714cf-7b18-484c-ab46-540e8f64e575 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.509555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.510270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.510555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.510816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.511607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:01.511911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.513700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.530056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 74/142] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:01.532684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.537242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.548700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c13898-a275-4767-98a9-7f0acb28c99f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.553346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891916-35d0-4556-b481-18a466ae482d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.559217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.560215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.560651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.560884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.563575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.564412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.564694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.564952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.566643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.569041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.571813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 75/143] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:01.579949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.590512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:01.592011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b7ddd-647f-4d60-bda1-3c8f7c1f060d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.598355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:01.600043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 69/144] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:01.608495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.611202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.611887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.612178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.612459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.624231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.632112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.634470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1da4-fb62-4250-b37d-2145ba831aaf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.649955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 76/145] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:01.651382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.652564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.653051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.653537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.655317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:01.655798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.656671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.658973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.671894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7672e-b7d4-4007-b065-528426ec341d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.686453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 70/146] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:01.688094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.689001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.689287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.689580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.692036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.693642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.694218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.696429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 77/147] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:01.704298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.714505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75736c00-cb38-4442-87a6-182860c496f3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.715148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f1ad-4b0b-4fb2-8e92-dbfcb467df8b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.732576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.733475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.733788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.734084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.738220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] RBAC: Adding query filter params (role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=6d553deefeab49daaeb29401ad6f9a26, user.id=6f6e729c07b0473793742efdbd331d64) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:01.738220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.738220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.739784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.741486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.742085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.742736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.749858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 78/148] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/role_assignments?user.id=6f6e729c07b0473793742efdbd331d64&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=562e684ed61e49f89bb4094923724b9b => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:01.750670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.755678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.760417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 71/149] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:01.766484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.781530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376e91-0d89-4cd7-9893-7aeb6d79aa00 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.795200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.795914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.796206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.796492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.806194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.808032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.818598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 79/150] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:01.826302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.859606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c2948-f8f2-4d4c-bba4-bc40c3d979b5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.876970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e678f-d3c8-43b0-8027-5f43b2d1211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.878642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e678f-d3c8-43b0-8027-5f43b2d1211a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.879178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e678f-d3c8-43b0-8027-5f43b2d1211a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.879709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e678f-d3c8-43b0-8027-5f43b2d1211a admin admin] PATH_INFO: `/v3/projects/43295c5b258041acb98f3fb32ccaba4d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.885515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e678f-d3c8-43b0-8027-5f43b2d1211a admin admin] RBAC: Authorizing `identity:get_project(project_id=43295c5b258041acb98f3fb32ccaba4d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.890654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e678f-d3c8-43b0-8027-5f43b2d1211a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.894438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 72/151] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/projects/43295c5b258041acb98f3fb32ccaba4d => generated 312 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:01.901658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:01.911655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd54ca-9a9d-4cc1-b09f-b81399f559bc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:01.926795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:01.927501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:01.927813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:01.928127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:01.929081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=43295c5b258041acb98f3fb32ccaba4d, user.id=6f6e729c07b0473793742efdbd331d64) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:01.929401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:01.931525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9acc-65e3-4f54-a7d4-4eb5cce2011a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:01.942650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 80/152] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:01 2021] GET /identity/v3/role_assignments?user.id=6f6e729c07b0473793742efdbd331d64&scope.project.id=43295c5b258041acb98f3fb32ccaba4d&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:02.844504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f372a7-a200-4fb0-80bf-7de255753af0 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:02.845234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f372a7-a200-4fb0-80bf-7de255753af0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:02.845500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f372a7-a200-4fb0-80bf-7de255753af0 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:02.849352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 73/153] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:02 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:02.856034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:02.856678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:02.856678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:02.871140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d937b6e-5c43-4aef-b07d-8f317c7083fb None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:02.871674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d937b6e-5c43-4aef-b07d-8f317c7083fb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:02.872495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d937b6e-5c43-4aef-b07d-8f317c7083fb None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:02.878652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 74/154] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:02 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:02.881076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:02.882374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:02.888170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:02.889162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:02.889997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:02.895526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 81/155] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:02.940146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:02.942562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:02.964906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 75/156] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:02.994905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.015936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701393-0e91-4647-af98-4bad0d1bcb52 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.021653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.031686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.033078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.033584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.034082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.055490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb1a7-933d-4e27-97ce-81d9668f508a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.072486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.073961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.074495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.074989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.076824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:03.102823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:03.105055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 82/157] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:03.121658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:03.136258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:03.142534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 76/158] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:03.143794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.163856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.172271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5252-95fd-4a36-881e-cb7aecfb23df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.182878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a38dd-ed37-4c01-9cc2-770aa644a82b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.190388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.192082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.192900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.193893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.196134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:03.197190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.200882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.204437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.205618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.206102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.207089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.208115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:03.208687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.221558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 83/159] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.224255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986460af-d171-4b61-95f1-ca847d59afbb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.232049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.258191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d70b59-00ea-44d1-9058-737bdff1f70b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.261870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 77/160] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:03.270237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78227e5-278a-4047-96a8-e0229d1ed316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.271210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78227e5-278a-4047-96a8-e0229d1ed316 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.271495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78227e5-278a-4047-96a8-e0229d1ed316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.271823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78227e5-278a-4047-96a8-e0229d1ed316 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.273415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fce72-e92d-4eb4-be35-d77b5ce8522d None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.274269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fce72-e92d-4eb4-be35-d77b5ce8522d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.275071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fce72-e92d-4eb4-be35-d77b5ce8522d None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.278961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 78/161] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:03 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:03.287908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fce72-e92d-4eb4-be35-d77b5ce8522d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.294211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78227e5-278a-4047-96a8-e0229d1ed316 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.297594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78227e5-278a-4047-96a8-e0229d1ed316 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.300402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 84/162] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:03.301408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.301694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.301969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.317272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fce72-e92d-4eb4-be35-d77b5ce8522d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.323644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.325052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.325468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.325895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.326786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:03.327497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.328067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:03.329436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.331374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 79/163] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.332183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.344242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 85/164] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:03.344885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.351691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c02169-ee87-412d-bf4f-1cf08b09d73b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.356517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303d28f-980d-4488-92e2-981dc3c14894 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.357863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.358717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.359003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.359283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.375247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.376017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.376348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.377915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.382450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.385292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.388059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.390962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.397448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 80/165] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:03.398828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.414184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 86/166] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:03.414184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.418525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6742b72-0aab-48fa-bb15-3a37fc8fb104 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.425645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217e81-62be-4e70-8d37-61e2b466ce76 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.427417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.428637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.429200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.429738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.431171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.432028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.432310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.432582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.434087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.436897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.439240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 87/167] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.440031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.446907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:03.455617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:03.463377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1b95-a1db-4ce2-94cc-5af032817a10 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.463574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 81/168] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:03.463574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.468347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.469248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.469526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.469967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.471938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.476075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.479373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 88/169] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.486190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.495127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d6e90-9341-4e00-b8e3-0c46dfb54293 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.502363 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.503401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.503870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.504367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.505394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd402463-dd2b-44f2-8e17-7cb4c09fe5ec admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.505717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user.id=b99c3887940341efa66a07ec4208c158) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:03.506547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.509040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.514914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.516069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.516381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.516663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.517326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 82/170] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/role_assignments?user.id=b99c3887940341efa66a07ec4208c158&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.517448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:03.517857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.518800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.524007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.562288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29981d2-a155-49e4-895c-df3ddcc654a6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.564800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 89/171] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.574903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.576812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.577581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.578358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.580333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=6d553deefeab49daaeb29401ad6f9a26, user.id=0d0f0af1db944cb5ab99675a88ef9fef) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:03.581242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.585275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.590281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.601357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 83/172] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/role_assignments?user.id=0d0f0af1db944cb5ab99675a88ef9fef&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.614028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed87b37-0ec3-4a38-98a4-033616cdbc88 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.634004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.634972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.635256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.635535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.643329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.645335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.647264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 90/173] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:03.656858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.679581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497bcf-92ad-4611-991c-316678f52bb8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.694565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.695641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.696169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.696889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.724861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.728665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.753296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 84/174] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:03.761477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.782728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabdd7b-7a00-45cf-be10-c9ba8583787b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.793363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239793a8-4d8b-4996-8424-f1b148401d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.794987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239793a8-4d8b-4996-8424-f1b148401d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.795486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239793a8-4d8b-4996-8424-f1b148401d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.795975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239793a8-4d8b-4996-8424-f1b148401d44 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.803560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239793a8-4d8b-4996-8424-f1b148401d44 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.807721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239793a8-4d8b-4996-8424-f1b148401d44 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.811836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 91/175] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:03.819902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:03.831867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a0fa-cd20-4df8-908e-e7da8f52b026 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:03.838418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:03.839695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:03.840191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:03.840743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:03.842305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user.id=0d0f0af1db944cb5ab99675a88ef9fef) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:03.842872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:03.845472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697e775-6a13-472e-b732-03963f9f3273 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:03.857166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 85/176] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:03 2021] GET /identity/v3/role_assignments?user.id=0d0f0af1db944cb5ab99675a88ef9fef&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:04.072467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6d8d8-b7c7-459d-961c-a7bb0eaca17d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.073108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6d8d8-b7c7-459d-961c-a7bb0eaca17d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.073458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6d8d8-b7c7-459d-961c-a7bb0eaca17d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.078127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 92/177] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:04 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:04.086380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.086888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.087405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.118064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:04.120129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:04.136237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 86/178] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:04.171253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6d8d8-b7c7-459d-961c-a7bb0eaca17d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.189248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6d8d8-b7c7-459d-961c-a7bb0eaca17d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.196599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.197617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.197926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.198248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.223256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:04.231919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:04.235134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 93/179] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:04.243110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.259928 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c1a91-e443-427f-a8bd-75e5f6ba21a6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.266782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.267900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.268374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.268856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.269847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:04.274257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.277064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.298200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 87/180] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:04.303295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.315250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d7d7-ee39-4da7-85a4-fc1376b3cf94 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.321681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.323022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.323471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.323914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.326006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.328735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.330899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 94/181] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:04.338666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.352278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9590b-8a95-4462-9aff-862e1f8bb8a1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.358551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f50513-9013-40e5-8e64-4c48e6cda1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.359586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f50513-9013-40e5-8e64-4c48e6cda1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.360138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f50513-9013-40e5-8e64-4c48e6cda1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.360641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f50513-9013-40e5-8e64-4c48e6cda1e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.371294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f50513-9013-40e5-8e64-4c48e6cda1e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.373932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f50513-9013-40e5-8e64-4c48e6cda1e2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.386877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 88/182] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:04.394378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.400380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289cfae-2004-4842-99e4-d05f83dfb9e7 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.400895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289cfae-2004-4842-99e4-d05f83dfb9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.401395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289cfae-2004-4842-99e4-d05f83dfb9e7 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.407449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 89/183] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:04 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:04.408921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4efe98-553a-4a3f-8f36-3208e53cdb28 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.415942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.416941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.417522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.418043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.418470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.418810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.418982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.421091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.423715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.426523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 95/184] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:04.433295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.444923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c43d1-2769-4cc7-8279-125686814889 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.452401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.453259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.453822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.454328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.455665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] RBAC: Adding query filter params (role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user.id=b99c3887940341efa66a07ec4208c158) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:04.456249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.458457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.458755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:04.461303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:04.471144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 96/185] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/role_assignments?user.id=b99c3887940341efa66a07ec4208c158&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=562e684ed61e49f89bb4094923724b9b => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:04.479288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:04.530480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.548761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b1b30-30b4-4257-9bed-cf67ffecf659 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.558379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b49c8b-d150-48e4-8517-b49079c8c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.560401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b49c8b-d150-48e4-8517-b49079c8c63f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.561160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b49c8b-d150-48e4-8517-b49079c8c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.561976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b49c8b-d150-48e4-8517-b49079c8c63f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.564753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b49c8b-d150-48e4-8517-b49079c8c63f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.568640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b49c8b-d150-48e4-8517-b49079c8c63f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.578520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 97/187] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:04.584973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:04.604264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c157ef-b845-4b03-8314-aa99dc068f34 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:04.613903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e420f-dd57-403e-ab39-d58de26c5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:04.615476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e420f-dd57-403e-ab39-d58de26c5712 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:04.616201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e420f-dd57-403e-ab39-d58de26c5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:04.616906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e420f-dd57-403e-ab39-d58de26c5712 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:04.618862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e420f-dd57-403e-ab39-d58de26c5712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:04.623571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e420f-dd57-403e-ab39-d58de26c5712 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:04.664196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 91/188] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:04 2021] POST /identity/v3/users => generated 293 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:06.962276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e99b-69ec-4155-b4a6-7123cd2a3439 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:06.963312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e99b-69ec-4155-b4a6-7123cd2a3439 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:06.963795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665e99b-69ec-4155-b4a6-7123cd2a3439 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:06.966243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 98/189] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:06.975474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:06.976592 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:06.977097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.011521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:07.013110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:07.028245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 92/190] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:07.076366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665e99b-69ec-4155-b4a6-7123cd2a3439 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.092262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665e99b-69ec-4155-b4a6-7123cd2a3439 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.104842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6e36d-10da-4bc6-ba4a-9eff18a22656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.106601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6e36d-10da-4bc6-ba4a-9eff18a22656 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.107409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6e36d-10da-4bc6-ba4a-9eff18a22656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.108477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6e36d-10da-4bc6-ba4a-9eff18a22656 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.124684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6e36d-10da-4bc6-ba4a-9eff18a22656 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:07.132160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8fd6e36d-10da-4bc6-ba4a-9eff18a22656 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:07.133644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 99/191] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:07.145305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.155411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346b49f-7ce8-4bef-a8c0-a176672ca195 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.165997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.167015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.167492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.167958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.168958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:07.169483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.171586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff90ac-0ee5-4689-b53f-bc4534f3a274 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.181580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e407d-1133-4f5c-a360-c5ca0dc0ae1e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.181580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e407d-1133-4f5c-a360-c5ca0dc0ae1e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.182086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e407d-1133-4f5c-a360-c5ca0dc0ae1e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.185318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 93/192] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.185672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 100/193] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:07 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:07.193714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.193993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.194314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.198706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e407d-1133-4f5c-a360-c5ca0dc0ae1e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.251516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e407d-1133-4f5c-a360-c5ca0dc0ae1e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.268660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.270325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.270869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.271374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.279946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.283583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.295399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 101/194] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.307219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.342074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8809-8433-4980-b7c3-6d2e8ffb1f34 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.367447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.369028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.369583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.370104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.372413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.376713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.383690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 102/195] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.385004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:07.386500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:07.400109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 94/196] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:07.401857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.425059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453858b-082d-4e77-9c68-b321bf604858 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.434745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.436185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.436713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.437239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/users/0d0f0af1db944cb5ab99675a88ef9fef/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.438945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.448863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc321-1c3b-48c5-a8be-fa3180c25e58 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.451324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user_id=0d0f0af1db944cb5ab99675a88ef9fef, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.454349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.463260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6f15-b463-4d90-9d27-59c8fc2b186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.463456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6f15-b463-4d90-9d27-59c8fc2b186b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.463712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6f15-b463-4d90-9d27-59c8fc2b186b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.463886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6f15-b463-4d90-9d27-59c8fc2b186b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.479435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 103/197] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:07 2021] PUT /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/users/0d0f0af1db944cb5ab99675a88ef9fef/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:07.491552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b6f15-b463-4d90-9d27-59c8fc2b186b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:07.499895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-085b6f15-b463-4d90-9d27-59c8fc2b186b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:07.501125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 95/198] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:07.513365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.520503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9626-0f95-4079-8637-5606eaf82b89 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.520836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9626-0f95-4079-8637-5606eaf82b89 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.521071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9626-0f95-4079-8637-5606eaf82b89 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.523253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 96/199] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:07.531377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.531727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.531942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.567082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:07.568780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:07.599513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7b9d4-5257-4331-8691-b850ebc6d198 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.617809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.618536 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.618821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.619099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.620388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:07.620388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.621857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.642275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 104/200] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.650749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.657068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 97/201] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:07.661190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc442f-a791-4c6a-9224-f714372021e4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.665954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.666910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.667184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.667452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.668805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.671319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.673085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 105/202] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:07.683336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.695162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.700897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93c518-0e0f-4aab-ace9-a1f772fc3030 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.707617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a96b6-0fb4-40c7-92c4-6f9ff6329404 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.713435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.713865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.714370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.714650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.714926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.715383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.715815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.716238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.717830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.720196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.722209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 98/203] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.733536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.741046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:07.753074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:07.755375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90ca82-42c4-479e-a8d4-4609a447a75d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.757869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 106/204] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:07.768364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.770746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.775894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.776232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.776457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/users/b99c3887940341efa66a07ec4208c158/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.782831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user_id=b99c3887940341efa66a07ec4208c158, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.788453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.794037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892649cc-9524-4db8-9b21-69bd32e3e2b7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.801530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.802384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.802732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.803187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.807548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:07.807888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.812863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 99/205] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:07 2021] PUT /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/users/b99c3887940341efa66a07ec4208c158/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:41:07.814114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.827599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 107/206] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.836375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.916306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b900e0-7ce9-4c51-ac18-dafa6b6c09bd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.921636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7a367-b092-487e-9c10-0446a37d7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.922606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a367-b092-487e-9c10-0446a37d7921 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.922887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a367-b092-487e-9c10-0446a37d7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.923164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7a367-b092-487e-9c10-0446a37d7921 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.925055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7a367-b092-487e-9c10-0446a37d7921 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.927481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7a367-b092-487e-9c10-0446a37d7921 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.929332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 100/207] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.936672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.945628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad5cb6-5917-42a8-9fba-37446fc59f0b None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.945917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad5cb6-5917-42a8-9fba-37446fc59f0b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.946319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad5cb6-5917-42a8-9fba-37446fc59f0b None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.948469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 101/208] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:07.953009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d572-f114-4e0f-a17c-6777243a44cd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:07.962794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.963075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.963354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.966301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:07.967328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:07.967634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:07.968076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:07.970455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:07.972767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:07.975765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 108/209] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:07 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:07.983238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:07.994736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205da9-c1a9-4fb7-8ae7-38f60b547952 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.001931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.004335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.007196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.007856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/users/b99c3887940341efa66a07ec4208c158/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.012339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user_id=b99c3887940341efa66a07ec4208c158, role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:08.013569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:08.016768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:08.020954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:08.038639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 102/210] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:08.042738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 109/211] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:07 2021] PUT /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/users/b99c3887940341efa66a07ec4208c158/roles/562e684ed61e49f89bb4094923724b9b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:41:08.075282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:08.087080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d24018-dcba-4126-8efd-825b0e768da0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.163138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.164527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.165029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.165575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.181400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:08.189158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:08.190849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 103/212] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:08.198527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:08.222724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f760-1568-4376-82e3-f50d9fdab35f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.231612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.233260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.234089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.234836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.236677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:08.237498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:08.241354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:08.260730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 110/213] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:08.268476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:08.295284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72355-99e9-4c3e-910d-54a1b96e3f29 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.310058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eececa6-a19c-491e-bd52-e69c7e01cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.312246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eececa6-a19c-491e-bd52-e69c7e01cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.313011 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eececa6-a19c-491e-bd52-e69c7e01cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.313754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eececa6-a19c-491e-bd52-e69c7e01cc39 admin admin] PATH_INFO: `/v3/users/321720792e7448e3a2a3f3e734b2bca2` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.339073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eececa6-a19c-491e-bd52-e69c7e01cc39 admin admin] RBAC: Authorizing `identity:get_user(user_id=321720792e7448e3a2a3f3e734b2bca2)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:08.341991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eececa6-a19c-491e-bd52-e69c7e01cc39 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:08.344145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 104/214] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:08 2021] GET /identity/v3/users/321720792e7448e3a2a3f3e734b2bca2 => generated 293 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:08.350784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:08.362788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f232dd9-2242-46e8-8909-29795b8078f1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.368441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.369350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.369762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.370296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.371304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, user.id=321720792e7448e3a2a3f3e734b2bca2, scope.system=all) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:08.371793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:08.374262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b414-7ec5-4cbd-9a9b-37bb0ae863a1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:08.385621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 111/215] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Nov 10 15:41:08 2021] GET /identity/v3/role_assignments?user.id=321720792e7448e3a2a3f3e734b2bca2&scope.system=all&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:08.448978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8d6-7612-4eea-ae86-7bc8e2540dbc None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.449260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8d6-7612-4eea-ae86-7bc8e2540dbc None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.449539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8d6-7612-4eea-ae86-7bc8e2540dbc None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.451801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 105/216] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:08.459027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.459561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.460011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.485535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:08.487006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:08.502353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 112/217] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:08.555841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8d6-7612-4eea-ae86-7bc8e2540dbc None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:08.572280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8d6-7612-4eea-ae86-7bc8e2540dbc None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.578379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a2e72-2dca-4c04-8e76-2a97cf64ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.579289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2e72-2dca-4c04-8e76-2a97cf64ff83 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.579620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2e72-2dca-4c04-8e76-2a97cf64ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.579895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2e72-2dca-4c04-8e76-2a97cf64ff83 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.581191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2e72-2dca-4c04-8e76-2a97cf64ff83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:08.583028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2e72-2dca-4c04-8e76-2a97cf64ff83 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:08.584876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 106/218] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:08.591340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:08.602374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846c7d-a4c5-4687-87db-a89faa0a1457 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:08.614820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:08.615687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:08.616073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:08.616454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:08.617344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:08.618606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:08.618606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:08.618606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:08.620050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05757194-55c4-48ed-aed6-dc85d049f992 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:08.665109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 113/219] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:08 2021] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:10.945147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176bd7b-1ee4-4fc6-ada7-0ee2eec92273 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:10.945673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176bd7b-1ee4-4fc6-ada7-0ee2eec92273 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:10.945746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176bd7b-1ee4-4fc6-ada7-0ee2eec92273 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:10.947911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 107/220] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:10.957234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631ded-4b79-4d02-844f-25832ebebfab None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:10.957234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631ded-4b79-4d02-844f-25832ebebfab None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:10.957234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631ded-4b79-4d02-844f-25832ebebfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:10.979193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-99631ded-4b79-4d02-844f-25832ebebfab None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:10.980766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-99631ded-4b79-4d02-844f-25832ebebfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:10.989569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 114/221] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:11.015508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176bd7b-1ee4-4fc6-ada7-0ee2eec92273 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.028837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176bd7b-1ee4-4fc6-ada7-0ee2eec92273 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.030058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47f88-d01b-4ab2-b05f-c46166315706 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.030591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47f88-d01b-4ab2-b05f-c46166315706 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.031101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47f88-d01b-4ab2-b05f-c46166315706 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.033280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 115/222] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:11.038992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.039853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.040127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.040696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.048224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.048853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.049640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.058880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:11.067145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:11.068618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 108/223] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:11.076208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.083235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:11.084767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:11.088170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb88c31-276a-460c-93e2-e11039af8af4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.092743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.093610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.093887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.094179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.095080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:11.095445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.097212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.100013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 116/224] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:11.108504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 109/225] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.115023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.127766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f422b8-d1d1-4d8f-9cf4-fb203ebb8408 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.138620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.139904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.140387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.140907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.144012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.144613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.146976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.148987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 117/226] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.164828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115b4ed-2ae5-4f31-a799-683d5813c7c6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.167248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.178306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.179229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.179508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.179781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.184658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64b49d-400b-4310-8878-bbc39d6e6b72 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.200429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.200624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:11.201658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.202142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.202641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.213053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:11.214390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 110/227] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:11.222320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.231103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.233902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.235850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dfbd8-4a86-4dd0-91b7-4f50cbfda0b3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.246570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.247354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.247547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.247940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.250709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:11.250709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.250922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 118/228] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:11.252718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.265267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.276541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 111/229] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:11.280720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dadc88-11b6-47c5-9481-0acb4d483b18 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.283590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.296618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.297046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094a504-44a1-4478-bbc7-25edc00cd130 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.297515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.297799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.298077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.303132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.305328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.307300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 119/230] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:11.308239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.309490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.309970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.310601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.319568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.319934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.322206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.324691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 112/231] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:11.331455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.344951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b997d-b0dd-4713-acad-b14a0f228b38 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.347292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737361b-fe88-4ad6-9733-7dda8a92e34c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.359499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.359700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.360174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.360272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.360462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.360553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.360731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.360820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.361597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user.id=b99c3887940341efa66a07ec4208c158) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:11.361908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.363871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.376824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 120/232] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/role_assignments?user.id=b99c3887940341efa66a07ec4208c158&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:11.379159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.381033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.398018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 113/233] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:11.405245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.424532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901811-1ee6-43ac-839e-5f86a45d8b06 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.435431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d71ff-f730-4b32-83be-5ec189ae00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.436679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d71ff-f730-4b32-83be-5ec189ae00d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.437277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d71ff-f730-4b32-83be-5ec189ae00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.437751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d71ff-f730-4b32-83be-5ec189ae00d0 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.439290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d71ff-f730-4b32-83be-5ec189ae00d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.441572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d71ff-f730-4b32-83be-5ec189ae00d0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.448834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 121/234] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.451281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.469558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e63f16-4edf-48ae-afc1-1858bc596c5c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.483636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.484318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.484672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.485051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.485939 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user.id=0d0f0af1db944cb5ab99675a88ef9fef) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:11.486280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.488155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8c803-5c07-4cee-af81-ad80d6da62c6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.499439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 114/235] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/role_assignments?user.id=0d0f0af1db944cb5ab99675a88ef9fef&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.541185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4479-51ab-4515-857c-35f895bfbf6c None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.541843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4479-51ab-4515-857c-35f895bfbf6c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.542345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4479-51ab-4515-857c-35f895bfbf6c None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.544674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 122/236] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:11.552087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.552451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.552642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.584452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:11.586087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:11.598921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 115/237] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:11.645314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4479-51ab-4515-857c-35f895bfbf6c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.665210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4479-51ab-4515-857c-35f895bfbf6c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.672480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.673836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.674808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.675326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.694351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:11.702952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:11.704746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 123/238] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:11.713047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.728188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbe3b-82ec-40da-83b6-78594a5e515a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.737194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.737923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.738246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.738519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.739365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:11.739704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.741591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.755281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 116/239] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.761874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.776492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a61f-e010-470d-9ce0-1568ec063e71 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.782044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.783346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.783860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.784383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.785987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.788400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.794708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 124/240] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.802138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.816383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf08e-9f82-49ce-8fd3-0b365da25942 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.828526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4815-5c5e-4b20-b855-ba118c724f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.829269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4815-5c5e-4b20-b855-ba118c724f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.829562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4815-5c5e-4b20-b855-ba118c724f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.829832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4815-5c5e-4b20-b855-ba118c724f5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.846246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e4815-5c5e-4b20-b855-ba118c724f5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.848107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e4815-5c5e-4b20-b855-ba118c724f5a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.865367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 117/241] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:11.872315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.876379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfefa5b-63e6-4e22-b7ca-5f1d6f22d3b8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.876691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfefa5b-63e6-4e22-b7ca-5f1d6f22d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.876938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfefa5b-63e6-4e22-b7ca-5f1d6f22d3b8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.882188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 118/242] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:11.886206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.886504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.886786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.890707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a35369-cd4b-4656-ad29-76bffbbaa9c2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.896025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.896995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.898092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.898483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.899935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.902152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.904271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 125/243] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:11.911365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.921661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:11.923180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:11.927713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded21ab-71e1-4d8c-8c4f-a060f1a839e4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.932732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 119/244] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:11.938926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.940000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.940798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.941394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:11.942648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] RBAC: Adding query filter params (role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f, user.id=b99c3887940341efa66a07ec4208c158) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:11.943138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:11.945326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:11.953437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 126/245] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/role_assignments?user.id=b99c3887940341efa66a07ec4208c158&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=562e684ed61e49f89bb4094923724b9b => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:11.964715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:11.977405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6874e6-cba4-4fad-869a-5c428daebfc7 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:11.985092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:11.985936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:11.986258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:11.986544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.002473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:12.009632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:12.010978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 120/246] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:12.018077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:12.034021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63bb68-854a-41ea-ac33-89fdbfda13dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:12.042863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:12.043905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.044376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.044998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.046313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:12.046830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:12.048788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:12.066293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 127/247] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:12.068891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:12.083727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb60f0-351c-424f-86c2-cdaacd003f84 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:12.091083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42d16-c239-4b71-a3c8-eecdacfd906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:12.092749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42d16-c239-4b71-a3c8-eecdacfd906c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.093297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42d16-c239-4b71-a3c8-eecdacfd906c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.093762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42d16-c239-4b71-a3c8-eecdacfd906c admin admin] PATH_INFO: `/v3/users/321720792e7448e3a2a3f3e734b2bca2` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.097585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42d16-c239-4b71-a3c8-eecdacfd906c admin admin] RBAC: Authorizing `identity:get_user(user_id=321720792e7448e3a2a3f3e734b2bca2)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:12.100462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42d16-c239-4b71-a3c8-eecdacfd906c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:12.103936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 121/248] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:12 2021] GET /identity/v3/users/321720792e7448e3a2a3f3e734b2bca2 => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:12.110383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:12.124175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25c1e9-e6ae-464c-a0e2-758e6fe6b16f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:12.130842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:12.132100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.132559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.133034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] PATH_INFO: `/v3/system/users/321720792e7448e3a2a3f3e734b2bca2/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.136621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=321720792e7448e3a2a3f3e734b2bca2, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:12.138144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:12.138144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:12.138144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:12.139839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975020a-c56c-405a-bc57-4a61d78d7271 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:12.153494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 128/249] 10.222.0.60 () {58 vars in 1355 bytes} [Wed Nov 10 15:41:12 2021] PUT /identity/v3/system/users/321720792e7448e3a2a3f3e734b2bca2/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:12.841781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7ebc-dc26-41fc-9922-5b1d97df68bf None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.842221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7ebc-dc26-41fc-9922-5b1d97df68bf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.842576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7ebc-dc26-41fc-9922-5b1d97df68bf None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.844539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 122/250] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:12.851018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180832-f9be-4500-b967-5bbf99590473 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.851295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180832-f9be-4500-b967-5bbf99590473 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.851577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180832-f9be-4500-b967-5bbf99590473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.872766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-be180832-f9be-4500-b967-5bbf99590473 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:12.874417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-be180832-f9be-4500-b967-5bbf99590473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:12.883523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 129/251] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:12.909400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e7ebc-dc26-41fc-9922-5b1d97df68bf None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:12.924625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e7ebc-dc26-41fc-9922-5b1d97df68bf None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:12.930446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:12.931600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.932034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.932437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.946017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:12.953404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 10 15:41:12.954957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 123/252] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:12 2021] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:12.961337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571cf4e-ce4b-4a23-b7b8-169905ee5aa3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.961675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571cf4e-ce4b-4a23-b7b8-169905ee5aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.961786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:12.961958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571cf4e-ce4b-4a23-b7b8-169905ee5aa3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.965692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 130/253] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:12 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:12.976572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.977174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.977547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.977900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2deb-7b55-4967-8c73-44e7108faf68 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:12.984953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:12.988277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:12.988277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:12.988749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:12.989873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:12.990413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:12.992688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:13.002522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:13.004191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:13.005591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 124/254] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:12 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:13.011880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:13.012790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 131/255] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:13.027057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dede57-9dde-4661-b4a5-909ecb435a67 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:13.033041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:13.034023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:13.034396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:13.034660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] PATH_INFO: `/v3/users/413d44069ad04a94bc0cbd608354ee06` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:13.038319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:13.052953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c05b4d-f60a-4223-bfec-928180036dc6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:13.058997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:13.059800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] RBAC: Authorizing `identity:get_user(user_id=413d44069ad04a94bc0cbd608354ee06)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:13.060145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:13.060568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:13.061048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:13.063361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:13.064659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:13.065409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:13.068077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 132/256] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:13.076273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 125/257] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:13 2021] GET /identity/v3/users/413d44069ad04a94bc0cbd608354ee06 => generated 293 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:13.078494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:13.081096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:13.098193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641a092-2042-4ed8-821f-206c9afc7ef9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:13.099333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebdede-0485-4166-80b1-a6ef99fc4901 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:13.109716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:13.110506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:13.110793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:13.111067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] PATH_INFO: `/v3/groups` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:13.111529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:13.111815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:13.112835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:13.112947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:13.112947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:13.112947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:13.113341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:13.113877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:13.114083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c339e-1611-46f4-b348-aa76f6bc0a05 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:13.115645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] RBAC: Adding query filter params (role.id=04e1a5342ebc4c71aea2460dd0c42dd9, user.id=413d44069ad04a94bc0cbd608354ee06, scope.system=all) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:13.116215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:13.118938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb5e19-44b5-4a66-b6f2-a17715fa2a1d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:13.126268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 133/258] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Nov 10 15:41:13 2021] GET /identity/v3/role_assignments?user.id=413d44069ad04a94bc0cbd608354ee06&scope.system=all&role.id=04e1a5342ebc4c71aea2460dd0c42dd9 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:13.142116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 126/259] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Nov 10 15:41:13 2021] POST /identity/v3/groups => generated 229 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:41:15.126202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5800b5-4ecd-43a8-8652-8746067a9955 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:15.127100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5800b5-4ecd-43a8-8652-8746067a9955 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:15.127100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5800b5-4ecd-43a8-8652-8746067a9955 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:15.129666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 134/260] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:15.138609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:15.139378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:15.139571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:15.160607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:15.161813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:15.170590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 127/261] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:15.216518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5800b5-4ecd-43a8-8652-8746067a9955 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:15.235832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5800b5-4ecd-43a8-8652-8746067a9955 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:15.247359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:15.248628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:15.249124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:15.249578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:15.270667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:15.281928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:15.284779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 135/262] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:15.295960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:15.312852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485ef8c-ea41-4b11-933f-51a6f420e4e9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:15.321099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:15.322214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:15.322699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:15.323171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:15.324617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:15.325152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:15.328175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:15.340704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 128/263] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:15.347999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:15.363343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116628-8414-4883-96bd-60e46ecf4823 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:15.369113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687f6a2-ef5d-40fc-badd-81524a19be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:15.370291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f6a2-ef5d-40fc-badd-81524a19be85 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:15.370661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f6a2-ef5d-40fc-badd-81524a19be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:15.371178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687f6a2-ef5d-40fc-badd-81524a19be85 admin admin] PATH_INFO: `/v3/users/321720792e7448e3a2a3f3e734b2bca2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:15.372737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f6a2-ef5d-40fc-badd-81524a19be85 admin admin] RBAC: Authorizing `identity:get_user(user_id=321720792e7448e3a2a3f3e734b2bca2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:15.375441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687f6a2-ef5d-40fc-badd-81524a19be85 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:15.377439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 136/264] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:15 2021] GET /identity/v3/users/321720792e7448e3a2a3f3e734b2bca2 => generated 293 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:15.384817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:15.397291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40c08-a637-4a4c-b315-f17be716b19f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:15.404187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:15.404880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:15.405158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:15.405424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:15.406352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] RBAC: Adding query filter params (role.id=263e49b96efd4b2ca6397bef86f86309, user.id=321720792e7448e3a2a3f3e734b2bca2, scope.system=all) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:15.406667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:15.408617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5051-028e-4b6b-95eb-7e067ea3af1d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:15.436437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 129/265] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Nov 10 15:41:15 2021] GET /identity/v3/role_assignments?user.id=321720792e7448e3a2a3f3e734b2bca2&scope.system=all&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 510 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:16.024298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4030-5425-43c8-9769-a35b9d4488fe None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.024706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4030-5425-43c8-9769-a35b9d4488fe None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.025104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4030-5425-43c8-9769-a35b9d4488fe None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.027847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 137/266] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:16.035071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bb832-0d5b-44aa-bfad-df952dea415e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.035336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bb832-0d5b-44aa-bfad-df952dea415e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.035618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bb832-0d5b-44aa-bfad-df952dea415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.057095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-037bb832-0d5b-44aa-bfad-df952dea415e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:16.058396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-037bb832-0d5b-44aa-bfad-df952dea415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:16.072391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 130/267] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:16.112138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4030-5425-43c8-9769-a35b9d4488fe None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:16.126512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4030-5425-43c8-9769-a35b9d4488fe None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:16.132394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:16.133316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.133589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.133940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.135521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:16.137350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:16.139364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 138/268] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:16.140200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c647b-e51d-44e8-822f-e85b2d1284fa None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.140735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c647b-e51d-44e8-822f-e85b2d1284fa None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.140952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c647b-e51d-44e8-822f-e85b2d1284fa None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.143093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 131/269] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:16.147380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:16.153371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.153768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.154532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.160239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd916da-5ff3-4298-a1a2-dca7cc4b141c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:16.168438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:16.169122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.169418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.169746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] PATH_INFO: `/v3/groups` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.172804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:16.172804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:16.172804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:16.172804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:16.174791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:16.187235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:16.188529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:16.193640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 139/270] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Nov 10 15:41:16 2021] POST /identity/v3/groups => generated 226 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:16.196663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 132/271] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:16.223088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:16.238056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ec74-c60e-497e-aaa9-6cf25641503a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:16.244522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:16.246363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.246770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.247706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.272166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:16.280540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 10 15:41:16.281880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 140/272] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:16 2021] GET /identity/v3/roles/reader => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:16.289837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:16.301169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b167a-e495-4336-a2c1-5e2a16921328 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:16.307902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:16.308533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.308803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.309068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.309872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:16.310205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:16.312175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:16.322664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 133/273] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:16 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:16.331606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:16.343953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acfc0d-1d37-46ae-a947-99300c2aeae4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:16.349452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172fc15-26b8-4f8b-95fa-6a9d0a410d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:16.350386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172fc15-26b8-4f8b-95fa-6a9d0a410d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.350670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172fc15-26b8-4f8b-95fa-6a9d0a410d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.350946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172fc15-26b8-4f8b-95fa-6a9d0a410d17 admin admin] PATH_INFO: `/v3/users/413d44069ad04a94bc0cbd608354ee06` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.352339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172fc15-26b8-4f8b-95fa-6a9d0a410d17 admin admin] RBAC: Authorizing `identity:get_user(user_id=413d44069ad04a94bc0cbd608354ee06)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:16.354695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172fc15-26b8-4f8b-95fa-6a9d0a410d17 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:16.357637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 141/274] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:16 2021] GET /identity/v3/users/413d44069ad04a94bc0cbd608354ee06 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:16.366967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:16.379546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef370-5bf0-4aaf-bda0-6c80cc5cc92c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:16.385593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:16.387287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:16.387767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:16.388226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] PATH_INFO: `/v3/system/users/413d44069ad04a94bc0cbd608354ee06/roles/04e1a5342ebc4c71aea2460dd0c42dd9` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:16.390886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=413d44069ad04a94bc0cbd608354ee06, role_id=04e1a5342ebc4c71aea2460dd0c42dd9)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:16.391987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:16.391987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:16.391987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:16.393007 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb474e6-70c3-4b46-96d8-ba4ebea1d641 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:16.404801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 134/275] 10.222.0.60 () {58 vars in 1355 bytes} [Wed Nov 10 15:41:16 2021] PUT /identity/v3/system/users/413d44069ad04a94bc0cbd608354ee06/roles/04e1a5342ebc4c71aea2460dd0c42dd9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:19.805380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29b710-3273-4523-b617-10629828392f None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.806025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29b710-3273-4523-b617-10629828392f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.806380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29b710-3273-4523-b617-10629828392f None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.809912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 142/276] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:19.817819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f390f-a267-4c6a-99f1-f61fd9d44c16 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.818415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f390f-a267-4c6a-99f1-f61fd9d44c16 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.818774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f390f-a267-4c6a-99f1-f61fd9d44c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.841844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d55f390f-a267-4c6a-99f1-f61fd9d44c16 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:19.843234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d55f390f-a267-4c6a-99f1-f61fd9d44c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:19.858075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 135/277] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:19.904118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29b710-3273-4523-b617-10629828392f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:19.924546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29b710-3273-4523-b617-10629828392f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:19.929299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c1b57-2cc2-40fa-90a4-51f9fbea6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:19.930108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1b57-2cc2-40fa-90a4-51f9fbea6c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.930411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1b57-2cc2-40fa-90a4-51f9fbea6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.930688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c1b57-2cc2-40fa-90a4-51f9fbea6c82 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.947846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfa1d-06bf-4ad6-aea0-a844a279bd45 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.948220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfa1d-06bf-4ad6-aea0-a844a279bd45 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.948446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfa1d-06bf-4ad6-aea0-a844a279bd45 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.949432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c1b57-2cc2-40fa-90a4-51f9fbea6c82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:19.951651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 136/278] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:19.953024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c078-8957-44dd-a21b-cc7825f70c41 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.953307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c078-8957-44dd-a21b-cc7825f70c41 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.953582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c078-8957-44dd-a21b-cc7825f70c41 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.956904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2e5c1b57-2cc2-40fa-90a4-51f9fbea6c82 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 10 15:41:19.958261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 143/279] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:19 2021] GET /identity/v3/roles/reader => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:19.958993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 137/280] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:19.959866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.960157 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.960433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.966766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c078-8957-44dd-a21b-cc7825f70c41 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:19.989784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c078-8957-44dd-a21b-cc7825f70c41 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:19.995724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:19.996271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:19.996967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:19.997251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:19.997414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:19.997617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:19.998403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:19.998824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.000505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3eb25-8ec1-4049-b355-a068ef044289 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.011601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 138/281] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:19 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:20.012945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 144/282] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:20.013664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.013960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.014346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.019982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.036989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07766397-7bf2-4fce-836a-670ebbcf225c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.054700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbd422-945c-4bb2-b3aa-d1fe6130e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.055686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd422-945c-4bb2-b3aa-d1fe6130e644 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.055901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd422-945c-4bb2-b3aa-d1fe6130e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.056171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd422-945c-4bb2-b3aa-d1fe6130e644 admin admin] PATH_INFO: `/v3/users/413d44069ad04a94bc0cbd608354ee06` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.058097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:20.059726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:20.060508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbd422-945c-4bb2-b3aa-d1fe6130e644 admin admin] RBAC: Authorizing `identity:get_user(user_id=413d44069ad04a94bc0cbd608354ee06)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.063311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbd422-945c-4bb2-b3aa-d1fe6130e644 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.066136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 145/283] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/users/413d44069ad04a94bc0cbd608354ee06 => generated 293 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:20.067868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8f59-763b-46ba-9686-bfa9f94ba978 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.069090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8f59-763b-46ba-9686-bfa9f94ba978 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.069633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8f59-763b-46ba-9686-bfa9f94ba978 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.071887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 146/284] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:20.073393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8f59-763b-46ba-9686-bfa9f94ba978 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.078188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 139/285] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:20.078188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.086821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027685-2459-45a3-bee4-46bd6486924c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.092028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.092706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.093052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.093371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.094527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] RBAC: Adding query filter params (role.id=04e1a5342ebc4c71aea2460dd0c42dd9, user.id=413d44069ad04a94bc0cbd608354ee06, scope.system=all) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.094869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.097068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8f59-763b-46ba-9686-bfa9f94ba978 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.097584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5eba-1e71-40e7-ac8f-55658c34e513 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.104473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.106119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.107412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.108018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.115162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 140/286] 10.222.0.60 () {56 vars in 1329 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/role_assignments?user.id=413d44069ad04a94bc0cbd608354ee06&scope.system=all&role.id=04e1a5342ebc4c71aea2460dd0c42dd9 => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.116531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.116815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.117094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.123873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:20.134395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:20.136042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 147/287] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:20.137127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.142261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:20.142261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:20.149624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 141/288] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:20.155277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fab9b-9a00-4a00-83d1-9800c34453eb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.159399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.162669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.163983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.164499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.165216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.172718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f95738-66f4-41c7-b397-ea83e13aafc5 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.191684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:20.192588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.193714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.194269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.194750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.195842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.196378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.198467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.199326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:20.201275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 148/289] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:20.203843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.211543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 142/290] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.212863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.228956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a727-02b6-4165-ae9c-85e1a948c571 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.229190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b11fe-68e9-4fb2-9c5a-a869c93a6829 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.235269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.236422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.236920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.237173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.237646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.238123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.238594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.239041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.239359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.240653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.242846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.264342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:20.265922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 143/291] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.267981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.277718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:20.279903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 149/292] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:20.281647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.288869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fa021-609f-4e74-8a3c-2871bf3fd046 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.299600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.301266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.302063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.302901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.307414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24806b-891c-4e04-b87c-a8b1a2b27111 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.316608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.317273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.317732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.318236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.322002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.326703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.332728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.335968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.340550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 144/293] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:20.341961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.353349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 150/294] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:20.360085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.361192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17128d18-24b8-4b37-94ce-87d284a254c3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.375901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ff87c-ea67-4d66-8807-41d6bf617664 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.377403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.378279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.378694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.379122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.380171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.380681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.382656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.398368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 145/295] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.399531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.399755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.401417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.401906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.406599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.409104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.412537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa84c0e-e2bd-425f-b4cf-dee3b82de6a5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.412960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.416283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 151/296] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.423776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.425035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.426720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.427297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.427911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.430095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.433405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.437397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 146/297] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.438676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.451660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a2996-6432-43b9-93e3-27cb86358e2b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.459031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.460736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.461370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.462183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.471589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396ac3-5a7c-4078-bdda-d271dc48aed9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.472817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.474072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:20.474072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:20.474072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:20.475758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.478057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 147/298] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.479276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.495343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.497213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.497797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.498338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.498590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c9247-98b4-4ba4-b16d-81f34594958f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.504267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.505490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.505966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.506424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.508491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.510964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.514413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 148/299] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.515635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.522045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.525628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.529463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23c36-6145-4acc-90dd-e278144ca45d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.535225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.536269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.536703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.537275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.539128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=6d553deefeab49daaeb29401ad6f9a26) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.539679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.542715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.551675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 149/300] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.552885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.556089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 152/301] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:20.565667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.574759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430da8-eeae-4147-ba62-dd48a05d8bdb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.584258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.585351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.585813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.586268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.587324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=6d553deefeab49daaeb29401ad6f9a26) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.587812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.591082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153139c-1f10-4319-8a59-66b4d651aa68 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.592413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.604188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 150/302] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=562e684ed61e49f89bb4094923724b9b => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:20.623442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.625036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.625525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.625814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.628452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.631122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.634362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 153/303] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:20.643709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.656315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcc5e-d729-432d-a34a-767e6c1f3cff admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.667971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec02e7c-d4b5-4730-aaf8-8909dfdacebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.669210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec02e7c-d4b5-4730-aaf8-8909dfdacebb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.669796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec02e7c-d4b5-4730-aaf8-8909dfdacebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.670262 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec02e7c-d4b5-4730-aaf8-8909dfdacebb admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.675196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec02e7c-d4b5-4730-aaf8-8909dfdacebb admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.678373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec02e7c-d4b5-4730-aaf8-8909dfdacebb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.681250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 151/304] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:20.689269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:20.722691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729d5a-f87a-408b-b18a-91533f438378 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:20.732994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:20.734046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:20.734530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:20.734963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:20.736855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:20.737361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:20.740905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0ae1e-c3ed-4f7d-b212-8986e992ae92 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:20.757630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 154/305] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:20 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 260 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:21.783278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599293c5-b598-4ccf-88b2-c5e9ef2667a3 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:21.784302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599293c5-b598-4ccf-88b2-c5e9ef2667a3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:21.784730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599293c5-b598-4ccf-88b2-c5e9ef2667a3 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:21.786855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 152/306] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:21.794088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be677b1-a09d-4630-a38d-43703240832c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:21.794779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be677b1-a09d-4630-a38d-43703240832c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:21.794779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be677b1-a09d-4630-a38d-43703240832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:21.815203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6be677b1-a09d-4630-a38d-43703240832c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:21.816486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6be677b1-a09d-4630-a38d-43703240832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:21.830794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 155/307] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:21.837786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733391e0-fd1a-402e-8e43-a3c425d40d9c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:21.838068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733391e0-fd1a-402e-8e43-a3c425d40d9c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:21.838428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733391e0-fd1a-402e-8e43-a3c425d40d9c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:21.840281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 153/308] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:21.857825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be677b1-a09d-4630-a38d-43703240832c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:21.858300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:21.858585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:21.858823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:21.874876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be677b1-a09d-4630-a38d-43703240832c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:21.892649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:21.893508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:21.893799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:21.894066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:21.895807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:21.897201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:21.915699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:21.923760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:21.925489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 156/309] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:21.931440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 154/310] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:21.935588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:21.947105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e233-cbdc-4336-a039-47cc589fb2be admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:21.958637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:21.959371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:21.959658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:21.959927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:21.960723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:21.961027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:21.962796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:21.980588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 157/311] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:21.988684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.006767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86f828-dc31-41f9-acea-6b785a01703a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.016488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.017481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.017894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.018340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.028539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.031648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.033543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.050619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b129d-261a-4190-b4a3-a2f6e3d52e51 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.050938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 155/312] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:22.059979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.061398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.061686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.061964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.062144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.076477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:22.076805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c92a-20b6-4d43-8ce7-933a304f0bbc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.084316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.085010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:22.085587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.085873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.086174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.086781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:22.091664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.094444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.094966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.097222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 156/314] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:22.103536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.121265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfeabf-4239-4e16-81d7-cd797be2376f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.137356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.139967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.142260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.142770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.144816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befef70-4966-41bb-bc70-153287ce017c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.145926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:22.146499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.155360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.159426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.161749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.163842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.166002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.175438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 159/315] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:22.175718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.179222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.182096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 157/316] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:22.189328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.192048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.207236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808bfe-79e9-4b7d-a8a1-16acfddb3ce7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.209910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765375c-92b5-4bb9-85e1-2b64a7cfa733 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.221868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.222790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.223124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.223401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.223580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.224157 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.224545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.224839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.225818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:22.226148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.228400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.234812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.236821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.250832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=562e684ed61e49f89bb4094923724b9b => generated 260 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:22.258385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 158/318] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:22.261398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.276471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65776d79-1539-498d-8216-21736af2a28a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.285484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.286480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.286784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.287068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] PATH_INFO: `/v3/projects/5257eb1aa0954376ba58fe4f7b901cea` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.291419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] RBAC: Authorizing `identity:get_project(project_id=5257eb1aa0954376ba58fe4f7b901cea)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.293578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.297070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 161/319] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/projects/5257eb1aa0954376ba58fe4f7b901cea => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:22.305605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.328055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820405c7-e349-4c01-a3a4-2cbfb70b7633 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.338468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eee992-d2bc-4729-9ab9-7ff8e7526ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.340013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee992-d2bc-4729-9ab9-7ff8e7526ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.340505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee992-d2bc-4729-9ab9-7ff8e7526ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.340873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee992-d2bc-4729-9ab9-7ff8e7526ebb admin admin] PATH_INFO: `/v3/groups/6f597e265fc84e9181288d1d63d277c6` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.359794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eee992-d2bc-4729-9ab9-7ff8e7526ebb admin admin] RBAC: Authorizing `identity:get_group(group_id=6f597e265fc84e9181288d1d63d277c6)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.362056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eee992-d2bc-4729-9ab9-7ff8e7526ebb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.364429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 159/320] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/groups/6f597e265fc84e9181288d1d63d277c6 => generated 229 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:22.372932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:22.388683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc12cd4-fb2e-4116-9d20-bbaed457f69c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:22.396913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:22.397660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:22.397946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:22.398305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:22.399192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] RBAC: Adding query filter params (group.id=6f597e265fc84e9181288d1d63d277c6, role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=5257eb1aa0954376ba58fe4f7b901cea) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:22.399569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:22.401632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4888-edd3-4d1c-85b0-7fe9db015e22 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:22.411747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 162/321] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:22 2021] GET /identity/v3/role_assignments?group.id=6f597e265fc84e9181288d1d63d277c6&scope.project.id=5257eb1aa0954376ba58fe4f7b901cea&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:23.867888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edac03-67f8-42d7-b31a-fa4c2997a445 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:23.868823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edac03-67f8-42d7-b31a-fa4c2997a445 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:23.868823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edac03-67f8-42d7-b31a-fa4c2997a445 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:23.871137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 160/322] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:23.884876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:23.885869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:23.885869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:23.914693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:23.915919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:23.931603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 163/323] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:23.973538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edac03-67f8-42d7-b31a-fa4c2997a445 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:23.995008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edac03-67f8-42d7-b31a-fa4c2997a445 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.000334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.001171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.001443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.001690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.020759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:24.029285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:24.042203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 161/324] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:24.042622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.059138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c0c87-07de-4d3f-adbd-71caae3677bf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.065930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.066674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.066950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.067224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.068062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:24.068366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.070057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.087617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 164/325] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:24.096584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.111432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44141-d091-483d-83f5-497665a8f2df admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.122287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.123429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.123786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.124052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.125667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.128411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.130151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 162/326] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:24.136698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.152104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4ed8-1c44-454b-ab25-f56f82f539e1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.159884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89dc2-512b-4e1d-8e28-aaf0406822eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.160782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89dc2-512b-4e1d-8e28-aaf0406822eb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.161078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89dc2-512b-4e1d-8e28-aaf0406822eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.161317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89dc2-512b-4e1d-8e28-aaf0406822eb admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.162985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89dc2-512b-4e1d-8e28-aaf0406822eb admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.165311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89dc2-512b-4e1d-8e28-aaf0406822eb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.167254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 165/327] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:24.175749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.185953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0407f-7643-4b55-bb7b-919823911ec4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.198248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a4c9d-1467-45a2-942e-7447a69ef44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.199144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a4c9d-1467-45a2-942e-7447a69ef44b admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.199400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a4c9d-1467-45a2-942e-7447a69ef44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.199675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a4c9d-1467-45a2-942e-7447a69ef44b admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26/groups/d6a18ce6150243efa25046c529e7a517/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.207826 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a4c9d-1467-45a2-942e-7447a69ef44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d553deefeab49daaeb29401ad6f9a26, group_id=d6a18ce6150243efa25046c529e7a517, role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.210855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a4c9d-1467-45a2-942e-7447a69ef44b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.226746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 163/328] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Nov 10 15:41:24 2021] PUT /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26/groups/d6a18ce6150243efa25046c529e7a517/roles/562e684ed61e49f89bb4094923724b9b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:24.321021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193762bc-2de1-4fed-bea6-09d70ba48f4a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.321382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193762bc-2de1-4fed-bea6-09d70ba48f4a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.321570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193762bc-2de1-4fed-bea6-09d70ba48f4a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.323906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 166/329] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:24.331404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.331754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.331954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.359483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:24.360712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:24.464761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 164/330] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:24.506759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193762bc-2de1-4fed-bea6-09d70ba48f4a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.525584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193762bc-2de1-4fed-bea6-09d70ba48f4a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.534075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.535043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.535324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.535596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.551343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:24.559524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:24.561280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:24.572699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.587350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d167b-6040-4b55-813b-f8f0ea7c14a6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.593029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.593746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.594021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.594340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.595157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:24.595463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.597132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.613885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 165/332] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:24.622479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.797031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0f5be-6f2e-4182-b994-1185c45b8821 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.802258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.803231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.803484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.803782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.805291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.806421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:24.806421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:24.806421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:24.807620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d79d2-2a80-4ae2-9555-6b6f74a91eab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.814320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 168/333] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:24.818031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.845536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3833-c307-420f-b88d-961576496d77 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.845970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a72f49-ca98-4a04-a2a9-97cf01893211 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.846237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a72f49-ca98-4a04-a2a9-97cf01893211 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.846475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a72f49-ca98-4a04-a2a9-97cf01893211 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.849416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 169/334] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:24.855077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee53121-b204-4cae-bfcb-bcd6e8ba8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.855950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53121-b204-4cae-bfcb-bcd6e8ba8d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.856226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53121-b204-4cae-bfcb-bcd6e8ba8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.856481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53121-b204-4cae-bfcb-bcd6e8ba8d99 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.858415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee53121-b204-4cae-bfcb-bcd6e8ba8d99 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.860524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee53121-b204-4cae-bfcb-bcd6e8ba8d99 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.862277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 166/335] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:24 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:24.869095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a72f49-ca98-4a04-a2a9-97cf01893211 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:24.877984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.878932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.878932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.886213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a72f49-ca98-4a04-a2a9-97cf01893211 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:24.895328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:24.896493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:24.896769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:24.897022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/groups/d6a18ce6150243efa25046c529e7a517/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:24.900369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f, group_id=d6a18ce6150243efa25046c529e7a517, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:24.903200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:24.920764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:24.922329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:24.936169 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 170/336] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Nov 10 15:41:24 2021] PUT /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/groups/d6a18ce6150243efa25046c529e7a517/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:41:24.946843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 167/337] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:25.016346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:25.092472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161c101-7dcc-4009-aaa1-6afb2ea7234d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:25.102149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:25.103034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:25.103317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:25.103572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:25.117311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:25.125614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:25.128764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 171/338] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:25.139246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:25.151861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc89d-ad5a-43ef-8ecd-36b56616bf36 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:25.157040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:25.157730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:25.158008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:25.158338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:25.159088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:25.159387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:25.161072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:25.176307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 168/339] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:25.188842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:25.207792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4059f6-c763-4f25-ab78-0cb70b2d93e5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:25.214402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:25.214888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:25.214888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:25.215410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:25.217095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:25.219111 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:25.226313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 172/340] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:25 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:25.230576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:25.253437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f4118-bbc1-4cc5-8f3c-dcb7db963f8d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:25.262034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84957240-cec3-4a9d-9f19-0733a43fbb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:25.263372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84957240-cec3-4a9d-9f19-0733a43fbb90 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:25.263877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84957240-cec3-4a9d-9f19-0733a43fbb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:25.264107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84957240-cec3-4a9d-9f19-0733a43fbb90 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:25.271459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84957240-cec3-4a9d-9f19-0733a43fbb90 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:25.274140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84957240-cec3-4a9d-9f19-0733a43fbb90 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:25.276528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 169/341] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:25 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:25.283906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:25.305250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f321e-5896-497c-9fdf-ab8294300622 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:25.315997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c56397-6837-42b2-a8fd-fa0ffbbe5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:25.316934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c56397-6837-42b2-a8fd-fa0ffbbe5bad admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:25.317212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c56397-6837-42b2-a8fd-fa0ffbbe5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:25.317489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c56397-6837-42b2-a8fd-fa0ffbbe5bad admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26/groups/d6a18ce6150243efa25046c529e7a517/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:25.319710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c56397-6837-42b2-a8fd-fa0ffbbe5bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d553deefeab49daaeb29401ad6f9a26, group_id=d6a18ce6150243efa25046c529e7a517, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:25.322520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c56397-6837-42b2-a8fd-fa0ffbbe5bad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:25.343617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 173/342] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Nov 10 15:41:25 2021] PUT /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26/groups/d6a18ce6150243efa25046c529e7a517/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:26.344488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52e1c-1507-4935-b7c5-8a7ab200783e None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.345156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52e1c-1507-4935-b7c5-8a7ab200783e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.345341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52e1c-1507-4935-b7c5-8a7ab200783e None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.347767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 170/343] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:26.355014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.355752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.355752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.393888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:26.395284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:26.490862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 174/344] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:26.544659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52e1c-1507-4935-b7c5-8a7ab200783e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:26.566843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52e1c-1507-4935-b7c5-8a7ab200783e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:26.576094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:26.577045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.577368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.577714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.599588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:26.618003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:26.620093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 171/345] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:26.629912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:26.648380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272dbbc-00f3-4234-9b73-754f425dabf3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:26.658400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:26.659089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.659371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.659647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.660434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:26.660741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:26.662387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef73d62-bc7f-4f68-add9-5708167dcd3c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:26.681909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 175/346] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:26.690401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:26.708980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e1bc4-5efa-42ad-8728-f4964ad8b51e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:26.711434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294efc-89ed-4b27-9147-a0ce09bb97f4 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.711775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294efc-89ed-4b27-9147-a0ce09bb97f4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.712090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29294efc-89ed-4b27-9147-a0ce09bb97f4 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.715174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 176/347] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:26.720451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:26.721828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.722327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.722767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.725515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.725847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.726227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.727664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:26.732175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:26.735962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 172/348] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:26 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:26.748178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:26.765677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23802e0-7eb8-4d91-be38-cb413a5fc2cd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:26.766791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:26.768083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:26.782705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:26.783683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 177/349] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:26.784159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.784492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.784823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.791411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:26.794327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:26.796958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 173/350] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:26 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:26.803846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:26.816870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837106f-de5c-47b0-9ff9-b4800df7435b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:26.824852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:26.835098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:26.837463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.837742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.838016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/groups/d6a18ce6150243efa25046c529e7a517/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.841615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c00a-5c42-445d-b448-f8f12d075465 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:26.844555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f, group_id=d6a18ce6150243efa25046c529e7a517, role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:26.851575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:26.854621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:26.855777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:26.856117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:26.859571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:26.877892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 178/351] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Nov 10 15:41:26 2021] PUT /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f/groups/d6a18ce6150243efa25046c529e7a517/roles/562e684ed61e49f89bb4094923724b9b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:26.882662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:26.891944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:26.893946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 174/352] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:26.904262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:27.012363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1dd06-82d9-4102-907d-44fae4b51902 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:27.024217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:27.024977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:27.025262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:27.025515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:27.026391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:27.026705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:27.028463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:27.042316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 179/353] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:27.068701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:27.087805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99f669-552e-434a-aa4b-07b3080d998c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:27.099222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:27.100166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:27.100447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:27.100711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] PATH_INFO: `/v3/groups/6f597e265fc84e9181288d1d63d277c6` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:27.103200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] RBAC: Authorizing `identity:get_group(group_id=6f597e265fc84e9181288d1d63d277c6)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:27.105206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:27.107862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 175/354] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:27 2021] GET /identity/v3/groups/6f597e265fc84e9181288d1d63d277c6 => generated 229 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:27.117002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:27.133597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab120-fec8-468d-80e6-102bf6d2cc2c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:27.141497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f05a-db83-4283-b15a-28a8230496b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:27.142596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f05a-db83-4283-b15a-28a8230496b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:27.142877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f05a-db83-4283-b15a-28a8230496b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:27.143199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f05a-db83-4283-b15a-28a8230496b9 admin admin] PATH_INFO: `/v3/projects/5257eb1aa0954376ba58fe4f7b901cea` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:27.145637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f05a-db83-4283-b15a-28a8230496b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5257eb1aa0954376ba58fe4f7b901cea)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:27.148604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f05a-db83-4283-b15a-28a8230496b9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:27.151091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 180/355] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:27 2021] GET /identity/v3/projects/5257eb1aa0954376ba58fe4f7b901cea => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:27.162474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:27.176542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af4a8-8112-4d3d-aabd-97a4d1f6985f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:27.186733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec33e7f-5253-4570-9bf6-0cb3af21b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:27.187658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec33e7f-5253-4570-9bf6-0cb3af21b98d admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:27.187941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec33e7f-5253-4570-9bf6-0cb3af21b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:27.188221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec33e7f-5253-4570-9bf6-0cb3af21b98d admin admin] PATH_INFO: `/v3/projects/5257eb1aa0954376ba58fe4f7b901cea/groups/6f597e265fc84e9181288d1d63d277c6/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:27.195294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec33e7f-5253-4570-9bf6-0cb3af21b98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5257eb1aa0954376ba58fe4f7b901cea, group_id=6f597e265fc84e9181288d1d63d277c6, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:27.198842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec33e7f-5253-4570-9bf6-0cb3af21b98d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:27.223863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 176/356] 10.222.0.60 () {58 vars in 1463 bytes} [Wed Nov 10 15:41:27 2021] PUT /identity/v3/projects/5257eb1aa0954376ba58fe4f7b901cea/groups/6f597e265fc84e9181288d1d63d277c6/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:28.384346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0191-9465-448f-b967-b4b88f47bd23 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.384864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0191-9465-448f-b967-b4b88f47bd23 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.384937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0191-9465-448f-b967-b4b88f47bd23 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.387190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 181/357] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:28.394694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.395348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.395556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.427578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:28.429053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:28.531931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 177/358] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:28.580571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0191-9465-448f-b967-b4b88f47bd23 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.615120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0191-9465-448f-b967-b4b88f47bd23 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.627691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.629153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.629646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.630144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.657543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:28.665484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:28.666925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 182/359] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:28.677419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.697584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb817aa-a603-4ff4-8fd7-ae494f2e1cce None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.705151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.710393 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.710919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.711420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.712905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:28.713465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:28.716734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:28.740538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 178/360] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:28.746562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.761630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bf1f-1bfe-443b-8629-171c8567de00 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.775584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d161131-178c-4828-a4a3-1d879bcd44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.776299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d161131-178c-4828-a4a3-1d879bcd44d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.776583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d161131-178c-4828-a4a3-1d879bcd44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.776862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d161131-178c-4828-a4a3-1d879bcd44d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.791051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d161131-178c-4828-a4a3-1d879bcd44d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:28.792801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d161131-178c-4828-a4a3-1d879bcd44d4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:28.803731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 183/361] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:28.810749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.827270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8c74-4bda-418b-bdd9-c28cfdcac503 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.828318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8c74-4bda-418b-bdd9-c28cfdcac503 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.828603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8c74-4bda-418b-bdd9-c28cfdcac503 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.830833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 184/362] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:28.834102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4869-057c-4615-80b5-c06382cd6477 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.841101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.841495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.841750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.848706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.849591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.849858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.850139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.853071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:28.855185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:28.857178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 179/363] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:28.865105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.872429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:28.873943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:28.883182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bb9b4-17cd-46ed-8d78-2d1c3a58294e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.890794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.891691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.891983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.892281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.895846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 185/364] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:28.896699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:28.899015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:28.906327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:28.908560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.925092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04faf7-3b59-41d9-93bd-cc5ef2f22db6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.932682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:28.940991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.942083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.942577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.943021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.944588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=6d553deefeab49daaeb29401ad6f9a26) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:28.945113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:28.948738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:28.955122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4e34-d72b-4049-b46a-e87224ce158b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:28.960788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=562e684ed61e49f89bb4094923724b9b => generated 611 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:28.965548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:28.966567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:28.967049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:28.967377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:28.995559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:29.004105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:29.010658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 181/367] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:29.020022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.050861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0a851-63ee-4332-9117-f2fae7404f2a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.062731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.063421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.063704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.063984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.064827 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:29.065125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.066921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.083492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 187/368] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:29.090487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.112216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204c5b-f8d1-4956-a58c-a1db9e22bf35 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.122596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.123468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.123916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.124239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.139285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.141086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.158423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 182/369] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:29.166200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.181844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6c07-c4b8-4879-bfbc-48bb1778409a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.199100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.200034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.200305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.200808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.203478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.207453 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.215538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:29.219594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.246681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66280b9-a8b5-447d-a377-25d002c61260 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.254293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f5cfb-c3e9-48b4-acdd-332e2fd20810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.254293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f5cfb-c3e9-48b4-acdd-332e2fd20810 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.254293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f5cfb-c3e9-48b4-acdd-332e2fd20810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.254293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f5cfb-c3e9-48b4-acdd-332e2fd20810 admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.255756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f5cfb-c3e9-48b4-acdd-332e2fd20810 admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.257970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f5cfb-c3e9-48b4-acdd-332e2fd20810 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.268970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 183/371] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:29.287372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.302193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a297f-ae5c-4b2c-8eb0-20897b4f4004 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.322725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.323942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.324495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.325014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.326831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:29.327365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.330303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017791e-e76f-48e7-a55b-3a1a7893889d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.348600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 189/372] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 611 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:29.629761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f4a2-68d1-4d2b-9f0e-83329958f423 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.631126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f4a2-68d1-4d2b-9f0e-83329958f423 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.631821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f4a2-68d1-4d2b-9f0e-83329958f423 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.637081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 184/373] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:29 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:29.643889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.644636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.644636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.667759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:29.669000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:29.678809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 190/374] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:29.720533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f4a2-68d1-4d2b-9f0e-83329958f423 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.744622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f4a2-68d1-4d2b-9f0e-83329958f423 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.752720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.754104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.758765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.761947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.777554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:29.787316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 10 15:41:29.791422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 185/375] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:29.802699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.826508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e9aaa-838f-46b0-9bdb-1bf5bd1826f1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.832482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665242-d871-459e-9a89-504240167c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.833351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665242-d871-459e-9a89-504240167c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.833641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665242-d871-459e-9a89-504240167c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.834001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98665242-d871-459e-9a89-504240167c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.834888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98665242-d871-459e-9a89-504240167c8d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:29.835221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98665242-d871-459e-9a89-504240167c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.837003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98665242-d871-459e-9a89-504240167c8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.850279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 191/376] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:29.861676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.884244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b17c-3fa4-4a7a-854c-99b30684d5f8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.893055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.894754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.895660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.896461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.914898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.918842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.935876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 186/377] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:29.945597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665242-d871-459e-9a89-504240167c8d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:29.963768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98665242-d871-459e-9a89-504240167c8d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:29.971627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:29.973467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:29.974231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:29.974902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:29.977357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:29.981513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:29.985290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 192/378] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:29 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:30.003516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.013405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a6b00-11e4-4f32-a90f-cf0a8b8cad19 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.019221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c04d4-2b73-4092-9e17-fc22d84e33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.020556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c04d4-2b73-4092-9e17-fc22d84e33fa admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.020865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c04d4-2b73-4092-9e17-fc22d84e33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.021201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c04d4-2b73-4092-9e17-fc22d84e33fa admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.022806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c04d4-2b73-4092-9e17-fc22d84e33fa admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.024792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c04d4-2b73-4092-9e17-fc22d84e33fa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.026734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 187/379] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:30.033573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.044987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ca39a-a1b8-46e0-bc5f-3ece2934a51a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.052035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.052882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.053266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.053569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.054521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=263e49b96efd4b2ca6397bef86f86309, scope.project.id=6d553deefeab49daaeb29401ad6f9a26) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:30.054800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.056896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9c067-f4f3-4952-bba4-25a3c36566ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.065348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 193/380] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=6d553deefeab49daaeb29401ad6f9a26&role.id=263e49b96efd4b2ca6397bef86f86309 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:30.606282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67894b-cdcd-4f6f-b0f6-8108e200152e None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.606490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67894b-cdcd-4f6f-b0f6-8108e200152e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.606790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67894b-cdcd-4f6f-b0f6-8108e200152e None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.608676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 188/381] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:30.615737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.616025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.616297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.640493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:30.641818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:30.650997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 194/382] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:30.680509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67894b-cdcd-4f6f-b0f6-8108e200152e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.695223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67894b-cdcd-4f6f-b0f6-8108e200152e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.699785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.700638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.700917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.701192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.714360 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:30.723452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:30.725412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 189/383] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:30.732220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.746000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6600d-9ace-4006-95b5-32f6c6a31539 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.755128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.755824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.756116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.756396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.757215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:30.757606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.759220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e4d8-4521-420b-92a0-f2da2d28c58d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.769203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 195/384] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:30.776079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.789265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092510b-54d1-450e-a2b5-674746c00aac admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.795535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.796208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.796494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.796771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.810715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.813889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.826753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10847224-d754-40dc-8c37-d00c8b9ea9cf None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.827089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10847224-d754-40dc-8c37-d00c8b9ea9cf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.827309 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10847224-d754-40dc-8c37-d00c8b9ea9cf None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.829424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 196/385] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:30.829834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 190/386] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:30.836627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.837064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.837557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.838060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.846335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0251-6538-4cca-a775-5811960f2121 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.852455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.853403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.853679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.853949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.855321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.858767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.860934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 191/387] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:30.863740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:30.865732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:30.872111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.882568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 197/388] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:30.891215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a1a3-ebd1-4a1f-8c91-143bef2c5202 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.901235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.902801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.903255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.903814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] PATH_INFO: `/v3/groups/d6a18ce6150243efa25046c529e7a517` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.907161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] RBAC: Authorizing `identity:get_group(group_id=d6a18ce6150243efa25046c529e7a517)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.910959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.914070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 192/389] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/groups/d6a18ce6150243efa25046c529e7a517 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:30.919721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.927463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:30.930544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe81b0f-9011-4cb4-aead-88a174bb3d73 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.936429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.937460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.938068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.938068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.944755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9eb81a-a33c-4133-92af-32f6bb611c22 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:30.953367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:30.953834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:30.954128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:30.954472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:30.955313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] RBAC: Adding query filter params (group.id=d6a18ce6150243efa25046c529e7a517, role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:30.955626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:30.958969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:30.959177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:30.964814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 193/390] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/role_assignments?group.id=d6a18ce6150243efa25046c529e7a517&scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f&role.id=562e684ed61e49f89bb4094923724b9b => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:30.969022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:30.970781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 198/391] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:30.980260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:31.002273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cae5b5-196b-49f1-9309-c2ef3f2943ed admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:31.009104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:31.010336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:31.012289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:31.012289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:31.017399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:31.017399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:31.017399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:31.031000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 194/392] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:31.040929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:31.057141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbef06-0641-406f-93c4-a133f14b4235 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:31.062353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:31.063042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:31.063326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:31.063613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:31.073839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:31.076122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:31.089428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 199/393] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:31.096930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:31.108367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6b44-82fd-4fce-869b-61e893017d3a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:31.113298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:31.114122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:31.114546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:31.114993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] PATH_INFO: `/v3/projects/5257eb1aa0954376ba58fe4f7b901cea` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:31.116562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5257eb1aa0954376ba58fe4f7b901cea)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:31.118661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:31.120639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 195/394] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:41:31 2021] GET /identity/v3/projects/5257eb1aa0954376ba58fe4f7b901cea => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:31.128130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:31.138743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b88b2-1381-430a-8a7e-66bbd76209ff admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:31.145045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1943690-7e68-45db-af54-054168540ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:31.145723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1943690-7e68-45db-af54-054168540ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:31.146003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1943690-7e68-45db-af54-054168540ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:31.146322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1943690-7e68-45db-af54-054168540ba5 admin admin] PATH_INFO: `/v3/groups/6f597e265fc84e9181288d1d63d277c6` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:31.148246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1943690-7e68-45db-af54-054168540ba5 admin admin] RBAC: Authorizing `identity:get_group(group_id=6f597e265fc84e9181288d1d63d277c6)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:31.150282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1943690-7e68-45db-af54-054168540ba5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:31.152201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 200/395] 10.222.0.60 () {56 vars in 1201 bytes} [Wed Nov 10 15:41:31 2021] GET /identity/v3/groups/6f597e265fc84e9181288d1d63d277c6 => generated 229 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:31.172656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:31.184957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6a8e-ad57-496d-ab0c-8f3aa8d961a5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:31.189898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:31.190636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:31.190920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:31.191198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:31.192085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] RBAC: Adding query filter params (group.id=6f597e265fc84e9181288d1d63d277c6, role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=5257eb1aa0954376ba58fe4f7b901cea) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:31.192405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:31.194341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b538-3c7c-47e3-954e-3177e1545bce admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:31.201377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 196/396] 10.222.0.60 () {56 vars in 1397 bytes} [Wed Nov 10 15:41:31 2021] GET /identity/v3/role_assignments?group.id=6f597e265fc84e9181288d1d63d277c6&scope.project.id=5257eb1aa0954376ba58fe4f7b901cea&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:34.519465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb218-7460-4ae8-9144-a2d4e80f6218 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:34.520077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb218-7460-4ae8-9144-a2d4e80f6218 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:34.520246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb218-7460-4ae8-9144-a2d4e80f6218 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:34.523697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 201/397] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:34.530514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:34.531111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:34.531111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:34.561233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:34.562527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:34.573166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 197/398] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:34.640567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bb218-7460-4ae8-9144-a2d4e80f6218 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:34.667920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bb218-7460-4ae8-9144-a2d4e80f6218 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:34.680215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:34.681589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:34.682074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:34.682608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:34.705731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:34.709392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:34.745388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:34.748067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 202/399] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:34.754621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:34.777059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5773-00fa-49fd-89ce-06f58887c8bb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:34.792125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:34.792823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:34.793105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:34.793380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:34.794631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:34.795175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:34.797973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ff83-f726-460d-94dd-00e9bac1a618 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:34.830252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 198/400] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:34.840086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:34.863473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7efa9-3ccd-4641-9b30-83194595abd9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:34.876307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb2834-b8d7-4e1f-8164-5afc4eb0c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:34.877461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2834-b8d7-4e1f-8164-5afc4eb0c384 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:34.877946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2834-b8d7-4e1f-8164-5afc4eb0c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:34.878433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2834-b8d7-4e1f-8164-5afc4eb0c384 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:34.879759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2834-b8d7-4e1f-8164-5afc4eb0c384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:34.883414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2834-b8d7-4e1f-8164-5afc4eb0c384 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:34.930695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 203/401] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:34 2021] POST /identity/v3/users => generated 246 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:35.045565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953ee9-acc0-40b5-8089-b58f3c40937c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.045899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953ee9-acc0-40b5-8089-b58f3c40937c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.046343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953ee9-acc0-40b5-8089-b58f3c40937c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.049586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 199/402] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:35.073515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d1e7-bbef-43b8-b391-4e10115ed641 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.074007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d1e7-bbef-43b8-b391-4e10115ed641 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.074527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d1e7-bbef-43b8-b391-4e10115ed641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.115175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4f58d1e7-bbef-43b8-b391-4e10115ed641 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:35.117418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4f58d1e7-bbef-43b8-b391-4e10115ed641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:35.137351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 204/403] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:35.217789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953ee9-acc0-40b5-8089-b58f3c40937c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.244837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953ee9-acc0-40b5-8089-b58f3c40937c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.253877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.255377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.255863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.256415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.290537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.294367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.334066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d7b9b-7351-4d16-bea0-c10a68120647 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.334725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d7b9b-7351-4d16-bea0-c10a68120647 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.335229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d7b9b-7351-4d16-bea0-c10a68120647 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.337585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 205/404] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:35.341136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-d7a65aa6-09ca-4ddb-9957-2b553d850ffb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:35.341136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 200/405] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:35.348515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d7b9b-7351-4d16-bea0-c10a68120647 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.352358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56b6be-f3a6-4988-9d0f-a3989c596969 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.353099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56b6be-f3a6-4988-9d0f-a3989c596969 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.353786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56b6be-f3a6-4988-9d0f-a3989c596969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.387519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d7b9b-7351-4d16-bea0-c10a68120647 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.390489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7d56b6be-f3a6-4988-9d0f-a3989c596969 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:35.392913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7d56b6be-f3a6-4988-9d0f-a3989c596969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:35.398023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.398691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.399317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.399933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.401466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:35.402110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.410244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:35.410244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:35.410244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:35.410244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.416532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 201/406] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:35.444284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 206/407] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:35.448169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955dc0-9384-49b8-83e1-712724f762c7 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.448511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955dc0-9384-49b8-83e1-712724f762c7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.448782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955dc0-9384-49b8-83e1-712724f762c7 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.457305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 202/408] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:35.457907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.460548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.461038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.461516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.473486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be133f-81c8-4d54-a7be-9fd89cca62b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.486842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.487644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.487939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.488615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.489962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.490956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.506518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:35.508973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:35.517865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 207/409] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:35 2021] POST /identity/v3/users => generated 248 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:35.519144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.532420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 203/410] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:35.533184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a8e7-c4c9-403b-b761-ab9295cbb49f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.547380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.549307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.549773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.550405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.564996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.567347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.590721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:35.593382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 208/411] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:35.600628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.618308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa927-ca85-46be-ae79-f6e0bbbedf2f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.624320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.625356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.625816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.626403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.627381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:35.627948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.630039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.633732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.647878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfeb0d-a1f3-4143-9742-ca38f49da688 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.653047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.654127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.654671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.655073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 204/412] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:35.655352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.661633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.677621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60d14-cfce-4b5d-be40-28a5503abf31 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.679314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.682043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.682695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.686213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.686213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.686213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.686213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.687392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.713422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 205/413] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:35 2021] POST /identity/v3/users => generated 248 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:41:35.722192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:35.724617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 209/414] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:35.732240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.754482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9d96-0fd1-4b0a-ae3a-ca3c511e0dbb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.765345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.766207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.766557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.766979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.767927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:35.768307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.770450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbefa5-4c21-49f4-bf7b-eda0a8db699a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.796164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 206/415] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:35.803514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:35.827299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a24f-3ad6-4925-80f9-5446a83cca87 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:35.844015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc22d1-d7aa-4eb2-94bf-bea8f9427b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:35.846139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc22d1-d7aa-4eb2-94bf-bea8f9427b8f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:35.846836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc22d1-d7aa-4eb2-94bf-bea8f9427b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:35.847692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc22d1-d7aa-4eb2-94bf-bea8f9427b8f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:35.848904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc22d1-d7aa-4eb2-94bf-bea8f9427b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:35.851455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc22d1-d7aa-4eb2-94bf-bea8f9427b8f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:35.885229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 210/416] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:35 2021] POST /identity/v3/users => generated 249 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:36.732895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da20e-2f19-47d0-a7ce-eccad86190bb None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:36.733695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da20e-2f19-47d0-a7ce-eccad86190bb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:36.733695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da20e-2f19-47d0-a7ce-eccad86190bb None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:36.737505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 207/417] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:36.763630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:36.766735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:36.766930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:36.792672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:36.794713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:36.810940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 211/418] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:36.895476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da20e-2f19-47d0-a7ce-eccad86190bb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:36.933207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da20e-2f19-47d0-a7ce-eccad86190bb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:36.946459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:36.947630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:36.948077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:36.948528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:36.950049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:36.953271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:36.971488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.sql.core [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 10 15:41:36.971488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 10 15:41:36.971488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [parameters: {'id': '50350474ffde4563b6b648f97c2cfc11', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 10 15:41:36.971488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 15:41:37.003550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 10 15:41:37.005333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 208/419] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:41:36 2021] POST /identity/v3/roles => generated 144 bytes in 111 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:37.019043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:37.036463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2f01f-a032-4fbf-87e4-b5ada954a558 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:37.041237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1535ee-e795-46cc-b35b-7cfe846354ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:37.042073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1535ee-e795-46cc-b35b-7cfe846354ae admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:37.042380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1535ee-e795-46cc-b35b-7cfe846354ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:37.042653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1535ee-e795-46cc-b35b-7cfe846354ae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:37.073506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1535ee-e795-46cc-b35b-7cfe846354ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:37.088390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7f1535ee-e795-46cc-b35b-7cfe846354ae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 10 15:41:37.094645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 212/420] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:41:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:37.105572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:37.127917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8de9b-1b53-43f8-833a-f041a5083c08 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:37.140231 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:37.141542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:37.142050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:37.142569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:37.144045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:37.144590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:37.147845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debe55c-549f-4276-b8a0-b67257d03b12 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:37.175079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 209/421] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:38.653746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ded7d-d39b-406f-8fb4-d4bd6eab7b91 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.654300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ded7d-d39b-406f-8fb4-d4bd6eab7b91 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.654586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ded7d-d39b-406f-8fb4-d4bd6eab7b91 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.656991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 213/422] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:38.663874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.665168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.665682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.694690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:38.696388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:38.711105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 210/423] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:38.764594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ded7d-d39b-406f-8fb4-d4bd6eab7b91 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:38.785448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ded7d-d39b-406f-8fb4-d4bd6eab7b91 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:38.794353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:38.795680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.796159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.796633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.818630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:38.826103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:38.831550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 214/424] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:38.838381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:38.854515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d1860-399a-42a8-ab71-caa03b5560f0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:38.862532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:38.863563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.864076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.864555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.865547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:38.866116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:38.868071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f23a1-4dd0-4659-8ec2-ed81aa601a9e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:38.885584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 211/425] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:38.892259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:38.903167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a9a39-2072-4463-ac2c-f104c61a1c7d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:38.911764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:38.913372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.913986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.914491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.930395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:38.930795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd17a85-0c14-446f-a1d8-de657e72f949 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.931088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd17a85-0c14-446f-a1d8-de657e72f949 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.931362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd17a85-0c14-446f-a1d8-de657e72f949 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.933302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:38.933481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 212/426] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:38.939891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:38.940432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:38.940829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:38.961290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:38.961734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:38.962611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:38.964121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 215/427] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:38.970921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:38.972231 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 213/428] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:38.987355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99933210-60d6-40c2-9781-3b7b068c6595 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:38.998786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:38.999838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.000319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.000539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.001002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.001971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.002486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.004316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.010119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a7147-fa21-43df-8459-4c57462b0a4f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.015551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.016390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.016670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.016944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.027764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 216/429] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.036208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.038229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:39.046618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:39.049124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 214/430] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:39.056464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.059334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c4851-0f2e-4f97-97be-4dc373e514fa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.069195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40844de-107d-4fdc-b8be-1f0d5ffdabc1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.074000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.074747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.075176 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.075456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.076248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.076427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.076552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.077072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.077364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.077651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.078257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.089714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 215/431] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.098973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.099295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.101173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.121076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:41:39.123506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 217/432] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:39.134272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5667aa-5fad-4c84-8dfe-6f8e264b1111 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.136911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.148383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.151136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.151601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.152022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.170002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65b1d0-799e-4c15-bead-3dbd90e24d35 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.174956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.179961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.180456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.181450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.182617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.183938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.186573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.188305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.191363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:39.191363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:39.191363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:39.195938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.245140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:39.249004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 216/433] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.259345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.281906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 218/434] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.291711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.292822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f53a0-8b1d-45d4-a079-a0cee2e987be admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.299332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.300174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.300630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.300959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.302203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.302561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.305106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6038a-9ac8-4d59-892f-e49cb0867cfc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.309839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dd6ba-9a3a-48ad-8010-32a9fbe07f35 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.319104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060382ff-1ee6-49ae-bb71-bcfd80379c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.320298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060382ff-1ee6-49ae-bb71-bcfd80379c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.320766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060382ff-1ee6-49ae-bb71-bcfd80379c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.321302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060382ff-1ee6-49ae-bb71-bcfd80379c4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.322854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 217/435] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.324435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1d59-6ecc-482d-ad68-0e639e9eb4f2 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.324722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1d59-6ecc-482d-ad68-0e639e9eb4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.325004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1d59-6ecc-482d-ad68-0e639e9eb4f2 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.333550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 218/436] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:39 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:39.335318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1d59-6ecc-482d-ad68-0e639e9eb4f2 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.343238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060382ff-1ee6-49ae-bb71-bcfd80379c4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.345525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060382ff-1ee6-49ae-bb71-bcfd80379c4c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.349885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1d59-6ecc-482d-ad68-0e639e9eb4f2 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.355850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.357210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 219/437] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:39.357669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.358416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.359118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.364323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.364781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.365137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.370327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.373398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.389153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:39.391397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:39.401102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 220/438] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:39.402280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.412190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 10 15:41:39.415489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb68ec-f498-47e7-bdc6-7eef213ea745 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.421865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.422947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.423381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.424106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.426797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 219/439] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/users/glance => generated 84 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.439380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.447994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.452425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.456484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c435-bb2e-4c9d-8c75-77ece501b4d2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.462437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.463261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.463689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.463967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.464935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.465255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.467052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:39.467052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:39.467052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:39.468335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.491155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:39.494228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 221/440] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.496392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.517394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483f2b-e0c5-4e78-ba83-4e7b1bd01f31 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.525530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.527225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.527934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.528653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.534210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 220/441] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.536506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.556725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:39.558179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2647314-71c8-4cfb-8a2c-a309fb0e8d4e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.563982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.565156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.565780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.566385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.567782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.568522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.570658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.571446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:39.578992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 222/442] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.578992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.596281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8cdc-93f2-4c31-9393-30623ae20b6f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.605350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 221/443] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.605350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.605587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.605587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.605587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.605809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.616717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f6b3-981c-4dc9-978e-bd5a7ad15a7b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.620348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.621494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.622275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.622561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.622838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.623899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.624372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.624916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.626006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.642205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 222/444] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.642205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.645948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 223/445] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:39.647177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.656432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27886d-4e38-415b-9cd0-e0d42a7faf85 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.662718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.663717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c3229-e262-4ea1-aaf4-ab6433a11d9f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.664188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.664188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.664595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.669494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.670682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.671180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.671671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.677517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.681602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.684991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.687578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.706608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:39.708103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:39.708570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 224/446] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.709649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.717458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 223/447] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.721882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5cd96-e311-4ee1-9b9e-f466440161f6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.722608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.727312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.728435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.728928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.729392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.742232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.744672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.745823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4e11-4abb-471a-b840-cbac507b6fd3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.753688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.757725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.758277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.758750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.760568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.761043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.764001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.767748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:39.769513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 225/448] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.770559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.786849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 224/449] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:39.788334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.789236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cbe65-661e-4f79-aef9-936faf927afc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.800969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.801695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905593b-2a33-45dd-b561-14f44a4f0c1e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.801830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.802038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.802343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.803313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.803631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.805042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:39.805042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:39.805042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:39.806354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.808164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.809080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.809750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.810335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.811391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.811892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.813693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.826626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 225/450] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.827800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.835421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 226/451] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.836566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.846430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005dfcc-58df-416c-8822-3efbe4e207de admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.846991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eda501-647a-4742-9dd3-d099aba67659 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.851989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.852649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.852874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.853155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.853432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.854485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.854967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.855442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.863676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.864002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.866086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.866456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.884250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:39.888378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 15:41:39.890448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 227/453] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.891663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.897204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 226/453] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:39.904399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c94b4-f078-4cdf-8003-328440197243 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.909587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.910652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.911130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.911544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.911815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.913114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=599ea3b3d1f5426ea3218ecb443ca0d0) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.913754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.916213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.925744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f1938-64f3-4a86-a6d1-5c8726a8fe9d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.926595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 228/454] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/role_assignments?user.id=599ea3b3d1f5426ea3218ecb443ca0d0&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.928505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.931644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.932627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.933012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.933438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.934528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.935137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.937957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.942745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd62a-996e-4080-b069-8e9e6a351ce2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.948000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.948938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.949363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.949790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.951058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.951554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:39.953702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:39.967364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 227/455] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:39.968031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 229/456] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:39.976754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.977233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:39.988107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a6b5e-46cf-4087-8bef-b617b3ddaa00 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.993803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:39.994988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:39.995546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:39.996013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:39.996196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfc6e8-eab0-4809-871b-0edb0bd781b5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:39.997289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=06999fb0772947f584d5608ca26f9352) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:39.997802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.000092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.006438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.007645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.008017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 230/457] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/role_assignments?user.id=06999fb0772947f584d5608ca26f9352&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:40.008126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.014251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.025294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.029850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.049736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 228/458] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:40.060280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.078494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd54e7-167b-4165-b61e-adc18d8edd1f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.086120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.087492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.087943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.088396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.111156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.115224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.150304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-70a2e584-ec46-4963-b1fb-0656ddc7404d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:40.152891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 231/459] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:40.165299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.189017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a0cf-f406-497a-9ca6-c1a7377c5e2a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.202343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e6efe-7ef3-43f3-ad20-749c64a4fc9f None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.202580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.202829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e6efe-7ef3-43f3-ad20-749c64a4fc9f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.203228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e6efe-7ef3-43f3-ad20-749c64a4fc9f None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.203662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.204095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.204540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.205885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.206446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.207180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 232/460] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:40 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:40.211518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.236561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.237001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.237434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.247334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 229/461] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:40.256449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.288008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4d30-c0c0-43b0-9a2f-23dccf4c5dd5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.294091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:40.295529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:40.297629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.298873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.299122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.299405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.322710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 233/462] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:40.326364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.330331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.358458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:40.361232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 230/463] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:40.368247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.385608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92009a0e-58cf-4a3b-a7ea-c1d0849fee4d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.400871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.402308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.403102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.403489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.404232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.405091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.405402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.409457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.424419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 234/464] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:40.427945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707fcf9-3569-4873-9784-2a6a964a4760 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.432379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.440817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.441539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.441849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.442143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.454499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a996cb9-e596-47c7-ad5b-d4e3db38221c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.462997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:40.470407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:40.472045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 231/465] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:40.479591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.486473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.486473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.486473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.486473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=f74dc52500784e41bce60a945035ab74) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.486473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.488098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.488211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.502876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b8f2-a5a9-4a07-9a25-21c9b8427eb4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.508075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.509087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.509543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.509994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.510145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 235/466] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/role_assignments?user.id=f74dc52500784e41bce60a945035ab74&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:40.511136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.511644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.518190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21735f4d-0f3d-48d3-9578-3e689c8bdd96 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.534772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 232/467] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:40.546451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.578917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30f49d-ca68-4011-90b0-84a26c09e379 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.596579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.597987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.598524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.599032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.633622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.634897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70968a-b3eb-4ed8-8c2e-a01cfd1833f8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.635366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70968a-b3eb-4ed8-8c2e-a01cfd1833f8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.635817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70968a-b3eb-4ed8-8c2e-a01cfd1833f8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.637200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.638110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 233/468] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:40.644892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.645398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.645889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.666141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:40.668167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:40.679999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:40.683057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 236/469] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:40.683883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 234/470] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:40.693322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.712723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.720237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577868-228e-4545-a1f0-9d97e397024e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.736489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.736950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1455d-588b-4f7d-987a-87a264f698a6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.737705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.738294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.738840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.739761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.740419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.741816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.756068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.756915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.757203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.757562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.763850 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 237/471] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:40.774105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.785343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.795561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.801021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d251a2-b940-4018-84a5-3fd2b966f670 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.819401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.820284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.820557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.820853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.833476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.835575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.851913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:40.852721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 10 15:41:40.854846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 238/472] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/users/neutron => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:40.855333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 235/473] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:40.866023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.869575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.878614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046714-6931-4086-a1e2-5ad05f1fc572 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.886198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.886198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.886198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.886695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.887177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.887487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.890648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.896971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7d44-9593-4a49-a7d0-c0ce1ef35942 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.908928 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.909948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.910437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.910902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.911969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:40.912501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.914660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.922183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 239/474] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:40.927527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.947387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f84c-c827-4e99-9715-782378c5a0f2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:40.962184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:40.963388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:40.963877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:40.964577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 236/475] 10.222.0.60 () {56 vars in 1160 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:40.964824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:40.966450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:40.970667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:40.972720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:40.996605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964158e8-ecf5-4d6d-ac62-e12f3a67b1a9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:41.015403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:41.018526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:41.020636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:41.021202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:41.028605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 240/476] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:40 2021] POST /identity/v3/users => generated 247 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:41.050339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:41.053805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:41.077868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 237/477] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:41.085764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:41.107241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c0a9-17ec-4601-811a-34b0d5d92554 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:41.116925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:41.118704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:41.119187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:41.119686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:41.143750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:41.147477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:41.175318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:41.177070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 241/478] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:41.187516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:41.200817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d111a8-3aaa-4844-84a9-390f6279a071 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:41.209683 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:41.220062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:41.220686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:41.221420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:41.223150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:41.223813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:41.231181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:41.256897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 238/479] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:41.267476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:41.281674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a17a-617f-4296-9b43-c407d09103e8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:41.287834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:41.288932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:41.289318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:41.289700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:41.301643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:41.303779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:41.331307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:41.333608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 242/480] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:41.341245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:41.352131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795742a-023a-40f6-8400-b3ddcbaa2d60 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:41.357866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:41.358642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:41.358921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:41.359279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:41.360208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:41.360516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:41.361609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:41.361609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:41.361609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:41.362811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d66a7-b21f-429f-8780-36b1696593db admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:41.397735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 239/481] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:41.406103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:41.422888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8d7c5-0260-4c62-97b9-f1cb34037884 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:41.429681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:41.430525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:41.430875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:41.431217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:41.432207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=2ecc2dca57d045869f1fcf3a4337b990) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:41.432593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:41.434842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941fc12-0f35-4193-b61e-c70b5543f38d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:41.446099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 243/482] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:41 2021] GET /identity/v3/role_assignments?user.id=2ecc2dca57d045869f1fcf3a4337b990&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:43.323003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d56ad-e722-4cb0-b350-8078cc63a00f None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.323670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d56ad-e722-4cb0-b350-8078cc63a00f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.323670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d56ad-e722-4cb0-b350-8078cc63a00f None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.325973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 240/483] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:43.333155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.333815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.333815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.367824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:43.369886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:43.385666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 244/484] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:43.430794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d56ad-e722-4cb0-b350-8078cc63a00f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.448986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d56ad-e722-4cb0-b350-8078cc63a00f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.456605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a5b4f-f7b1-4b59-b3ef-b69d9368bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.457497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5b4f-f7b1-4b59-b3ef-b69d9368bf84 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.457778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5b4f-f7b1-4b59-b3ef-b69d9368bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.458048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5b4f-f7b1-4b59-b3ef-b69d9368bf84 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.474588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a5b4f-f7b1-4b59-b3ef-b69d9368bf84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:43.481220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b35a5b4f-f7b1-4b59-b3ef-b69d9368bf84 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:43.483044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 241/485] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:43.492774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.508849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07329fca-b759-4c88-9cba-f163e8a1f0d9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.518035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.518865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.519229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.519505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.520372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:43.520708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.522848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.536525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 245/486] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:43.546297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e317-45f2-40ca-8a54-2185d114db56 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.546676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e317-45f2-40ca-8a54-2185d114db56 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.546882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e317-45f2-40ca-8a54-2185d114db56 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.549425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 242/487] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:43.550289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.556782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.557214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.557634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.562970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bb6d5-5ed0-4836-bf8f-c74c557c7088 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.574912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.576217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.576685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.577133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.589438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:43.590888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:43.597917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.601801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.609308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 243/488] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:43.626101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:43.627909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 246/489] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:43.634979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.645978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.664723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816339b-30e0-4a90-8200-5f1e289f2ff3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.680432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.681610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.682091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.682589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.683941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:43.684534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.687510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.689005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a34907-07ee-4231-a0c0-13d179a4df43 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.698116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.699554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.700027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.700765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.721113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 244/490] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:43.729881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.735158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:43.760953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:43.763098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0346a0-9789-4de0-953c-3bcbf6f6714f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.767527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 247/491] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:43.775272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.776970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.782788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.783296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.785869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.809887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94722b0-003f-42eb-a29e-19cccd7373b2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.817418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.824488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.826933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.827347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.828366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.829152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.833054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:43.833605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.840711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.853551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 248/492] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:43.861331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 10 15:41:43.863416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.864365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 245/493] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/users/glance => generated 84 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:43.877647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.880467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcac8c-f64f-4b4b-8e50-1056f1e60b4e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.897141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0dc82-4669-404a-86dc-8ecc6c744c2c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.898503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.900192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.900858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.901558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.906199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.906430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.906974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.907514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:43.914194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:43.914194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.914194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.937498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:43.939822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:43.956904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 246/494] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:43.964813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.973448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:43.976068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b14db3-f73b-49e6-9d74-4817f8156895 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:43.980341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 249/495] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:43.985808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:43.986788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:43.987123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:43.990365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:43.995891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.015011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53a2e-83a5-4582-b36d-e6535ebe9dcb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.025675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.026427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.026789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.027181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.029526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.030359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.031139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.031607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.035330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.064917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 250/496] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.068490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:44.071737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.078280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 247/497] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:44.092662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06a85-cf34-472b-832d-d1e744a51084 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.099958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.102837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.110427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.110815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.111108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.119225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f568f2-cdfe-4532-8a71-70dbf4ab62a0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.127321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.132276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.135242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.136013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.136293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.136562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.138869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.139261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.144817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.167835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:41:44.170151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 251/498] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/users/nova => generated 82 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:44.175207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 248/499] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.180458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.182814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.197344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165553-8d43-4154-a1c1-58c3ac7d016a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.198257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9a584-0bd5-43cc-bf16-8656b66ca7ab admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.203629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.203883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.204790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.205076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.205270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.205421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.205927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.206346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.207352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.207785 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.209756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a5a57-b879-47d3-ac34-e30cff1831fc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.217552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.221083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.236224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 252/500] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.237961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1124ac-101c-4d1c-b2c0-7e4c2c4f7ae3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.238464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1124ac-101c-4d1c-b2c0-7e4c2c4f7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.238923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1124ac-101c-4d1c-b2c0-7e4c2c4f7ae3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.240242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:44.242010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 249/501] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:44.243043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 253/502] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:44.244559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.251206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.251494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.251737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.274212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:44.275019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b95266-8a7a-4b46-a29b-f63225675bc9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.275964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:44.283308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.284839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.285488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.286081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.287635 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 254/503] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:44.295180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.309121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.310817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e129f5-1e53-4254-b8a0-7115fd0eeae6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.313342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.319944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.320844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.321396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.321804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.322778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.323094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.330590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.341890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:44.344833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 250/504] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:44.346543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.351355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 255/505] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.358308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.360661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c5f32-1866-4c66-bb00-becc59b4a35e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.367816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.368789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.369205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.369303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37b202-5b07-4e47-8b44-d66b15efd7c0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.369649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.377840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.377840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.377840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.377840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.378414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.378414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.382191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.384452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:44.393827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:44.395173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 256/506] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.395571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 251/507] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:44.396090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.406070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.413742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad5c3a-d2f1-4454-9bf3-5ff425805519 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.418828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.419887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.420198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.420485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/06999fb0772947f584d5608ca26f9352/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.421088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68bfe-d048-4527-8e03-fca34cf138ac admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.427474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.428283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.428629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.428971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.429855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.430280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.432579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.439103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=06999fb0772947f584d5608ca26f9352, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.442132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.443805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 252/508] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.444819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.465596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c2d04-95ed-4476-af74-73266503eede admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.470231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 257/509] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:44 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/06999fb0772947f584d5608ca26f9352/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:44.471480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.537541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.540421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.540961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.541223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.562713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.565674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.581316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ffe0c315-7410-4686-9251-9e4b5313cf38 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:44.583124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 253/510] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:44.584616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776305-ff9e-4350-891f-e5349fc052db None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.584894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776305-ff9e-4350-891f-e5349fc052db None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.585165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776305-ff9e-4350-891f-e5349fc052db None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.592597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 254/511] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:44 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:44.593677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776305-ff9e-4350-891f-e5349fc052db None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.597950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406bde-ce9b-4bf9-af37-4d3378193d02 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.603912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.605125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.605415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.605691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.608298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776305-ff9e-4350-891f-e5349fc052db None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.613355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.614037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.614356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.614628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.615493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.615801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.617823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c83a-0a3f-4552-81db-6b7dab65899d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.621736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.623887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.633369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 255/512] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.634828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.635116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.635408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.650694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:44.652721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 258/513] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:44.659827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:44.661181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:44.662535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.678463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 256/514] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:44.679936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.681863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbef0f-99d0-479c-ad94-2e73fe8f1aab admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.697279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.701374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.702977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.703919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/599ea3b3d1f5426ea3218ecb443ca0d0/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.708305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2b3c1-6b25-4dff-82bf-110cdd984c59 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.713263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.713944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.714274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.714549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.715969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.716500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.718536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.726086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=599ea3b3d1f5426ea3218ecb443ca0d0, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.730031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.741686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 257/515] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:44.741686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.761182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936bed8-f96f-4c29-862d-3acea55a57dd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.769427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 259/516] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:44 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/599ea3b3d1f5426ea3218ecb443ca0d0/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:44.769991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.851318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.852070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.852352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.852632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.866509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:44.872634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113622-755a-4b51-b849-e83ca6ed911b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.875243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:44.876581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 258/517] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:44.883319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.884825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.884825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.884825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.892033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.899146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.902592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.909276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c478d9-fc73-4fe7-a9e7-c4a2245580b4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.916092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.917725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.918315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.918933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.920308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.920904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.923922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.925999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 15:41:44.927762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 260/518] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:44.935702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.947944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 259/519] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:44.954676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:44.962679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8314-4b35-43bf-8786-d25e759c7c99 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.968775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25f7c8-da01-43c9-ad9b-25f9734aee30 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:44.974113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.975216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.975639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.976080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.978500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:44.979396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:44.979767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:44.980226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:44.981464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:44.982058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.984334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d48e2-40e8-42cb-92de-17261d4147b9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:44.992950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:44.995600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.013671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 261/520] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.022608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:45.024334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 260/521] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:45.024922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d87d5-0933-4cc3-8634-8c3a42c093b0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.025553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d87d5-0933-4cc3-8634-8c3a42c093b0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.026228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d87d5-0933-4cc3-8634-8c3a42c093b0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.026352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.030276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 262/522] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:45 2021] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:45.033637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d87d5-0933-4cc3-8634-8c3a42c093b0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.037850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3280f-761f-4372-8c09-a5aa988681a5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.047588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.049264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.049706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.050148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.057065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d87d5-0933-4cc3-8634-8c3a42c093b0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.062390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.063263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.063644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.064024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.064961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.065399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.067228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222feeb-dba8-46e9-834f-99dc20a27aad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.068620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.071883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.083491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 263/523] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.085096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.085480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.085852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.099662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:45.101523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 261/524] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.104769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.115461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:45.117599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:45.125198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659de9-9e00-4561-bfee-b4067bc5a188 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.125859 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 264/525] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:45.129580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.132591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.133656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.134099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.134582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.147298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef180f9-77c1-4a99-bc4d-ab48dce05ac8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.151268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.153988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.155427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.156110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.156390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.156663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.157421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.157725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.159477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.171426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 15:41:45.176243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 262/526] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.176243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.176631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 265/527] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.182205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.189711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ff66d-2d1e-4968-8dd8-d9b43579a12c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.194366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7046-1dad-43f2-8d7c-3eeb041d8f29 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.196292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.197278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.197653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.198226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.199550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.200376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.200836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.201122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.202031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.202393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.204336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.220263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:45.226740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 266/528] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:45.227671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.228906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:45.230456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 263/529] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.235305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.250788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24116d-877c-424a-87da-ca0393f0b0aa admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.254422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180ee2-6639-4dea-be1d-09727be70fb0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.256782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.258291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.258993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.259624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.259767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.260444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.260730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.261011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.272779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.273048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.275020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.275252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.290288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 264/530] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:45.291776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.300665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:45.302636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 267/531] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.303527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.315860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5e888-1816-4fb0-9435-f353ed8010f9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.327896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.329748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.329748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.331674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601d99-5bfb-44ef-9bfc-bd851d1f1ad5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.332387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.333303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.333618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.335480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.340764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.342656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.343423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.344038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.350290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 265/532] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.351421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.358432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.361026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.367389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1940-6f63-4598-a65e-d7928689a6a0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.372518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.373256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.373535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.373933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.374713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.375079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.377141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.384552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:45.386674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 268/533] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.388464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.408766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd8aac-e9ec-483c-8589-2f9008a05a2d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.409232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 266/534] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.410468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.421745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.422015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf90eec-98ef-4ae2-a11a-f2d1bec9bfa6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.422647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.422926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.423192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.430729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.432258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.433030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.433773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.434941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.435776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.436589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.437977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.439069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.454977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 267/535] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.456557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.463683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:45.465529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 269/536] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.467715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.477308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af537f-30ac-406d-8de4-63d2d21a610c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.478219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f170bb-9601-4220-91c0-a8729bda96b8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.484488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.485333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.485607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.485870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.486817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.488531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.489301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.489781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/f74dc52500784e41bce60a945035ab74/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.494684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.499579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.511122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=f74dc52500784e41bce60a945035ab74, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.516392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.526958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:45.529834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 270/537] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.531667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.536882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 268/538] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:45 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/f74dc52500784e41bce60a945035ab74/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:45.540113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.564108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d821d1-ec44-4ac6-ac58-e6166e94a4e3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.652602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b28e0-a144-4558-8db2-18ef13c7b8e9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.666203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.667739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.670351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.671101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.674294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.675604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.679876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.719522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 269/539] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:45.722334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.723845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.724653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.725410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.727126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.728136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.729892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.732787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.753497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3337-e1ce-4ba0-8af2-69ad8f6bab4c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.765866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.767397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 271/540] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.768491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.769041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.769516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.770887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=025c8b235c244612932e1c931b40cf35) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.771559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.773805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.778323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.791871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 270/541] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/role_assignments?user.id=025c8b235c244612932e1c931b40cf35&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.794766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175856d-42c2-4fff-a132-98951d5adfe8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.801775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.803793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.804620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.805442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.820756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.823539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.844116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 10 15:41:45.846222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 272/542] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/users/neutron => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:45.854682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.866759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e02ca-e1c7-482a-8d0f-687d30865c28 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.878403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.879550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.880056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.880781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.882019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:45.882709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.885103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.908601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 271/543] 10.222.0.60 () {56 vars in 1160 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:45.915066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:45.930355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cabeaa-3b74-465c-8f5c-6c3200ec77d7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:45.937790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:45.939541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:45.940249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:45.940793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:45.956193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:45.958816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:45.987513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:45.990306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 273/544] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:45.996978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:46.015426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16b00-3cc0-4775-b889-e09e3d1fdbef admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:46.028575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:46.030287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:46.031142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:46.031685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:46.032773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:46.033347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:46.035338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:46.050542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 272/545] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:46.060866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:46.080036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad738-c54d-4499-aaec-196d5cbb9fe0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:46.091364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:46.093485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:46.094338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:46.095136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:46.111823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:46.114326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:46.137707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:46.139750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 274/546] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:46.146369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:46.160694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6806da-79cf-4d8c-86a9-47e69fe4cd26 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:46.166345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:46.167027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:46.167345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:46.167625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:46.168466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:46.168902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:46.171055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ca3b-1ba7-4de5-bc44-28955176dff1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:46.196684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 273/547] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:46.204335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:46.235558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe79b4-acfc-4d83-80ec-476d3f37461d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:46.246216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbb072-8c95-489c-9290-9540d6c39fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:46.249246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbb072-8c95-489c-9290-9540d6c39fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:46.249987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbb072-8c95-489c-9290-9540d6c39fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:46.250757 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbb072-8c95-489c-9290-9540d6c39fa2 admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/2ecc2dca57d045869f1fcf3a4337b990/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:46.274896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbb072-8c95-489c-9290-9540d6c39fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=2ecc2dca57d045869f1fcf3a4337b990, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:46.278777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbb072-8c95-489c-9290-9540d6c39fa2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:46.299058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 275/548] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:46 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/2ecc2dca57d045869f1fcf3a4337b990/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:41:48.139226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2cb6-04b9-4589-84aa-ba53768ba44d None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.139756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2cb6-04b9-4589-84aa-ba53768ba44d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.140173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2cb6-04b9-4589-84aa-ba53768ba44d None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.144070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 274/549] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:48 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:48.154554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.155084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.155532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.194446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:48.196465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:48.322028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 276/550] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:48.367289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2cb6-04b9-4589-84aa-ba53768ba44d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.385416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2cb6-04b9-4589-84aa-ba53768ba44d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.393124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.394401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.395019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.395605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.415134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:48.429494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:48.438338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 275/551] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:48.442933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.459811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f163-6bd5-4c66-983c-18ef58d0fccf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.467415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.468554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.469044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.469517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.471011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:48.471561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:48.474979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:48.498316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 277/552] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:48.501959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.518545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926f3e7-7ffd-4182-9999-00fd7bd7c135 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.525416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.526654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.527069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.527479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.546931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:48.550521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:48.581778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:48.587953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 276/553] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:48.595581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.613804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3a474-760c-43f4-a5ce-cff3a0bcb336 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.621798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.623030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.623521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.624015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.625403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:48.625958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:48.629140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:48.658400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 278/554] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:48.662035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.680392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453dfc1-dda9-4324-863b-e88979bf2995 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.688334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.689784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.690328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.690803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.706391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:48.710903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:48.738721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-d1b3c1d2-b21b-4822-b169-7decdd3aff70 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 10 15:41:48.746313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 277/555] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:48.756361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.774144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d4dd-c6a4-491e-9996-77be4d52e02c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.781962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.783556 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.784001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.784441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.785229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63b5f-a57a-4ed1-a007-36cf8f17ece7 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.785690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63b5f-a57a-4ed1-a007-36cf8f17ece7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.785987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:48.786181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63b5f-a57a-4ed1-a007-36cf8f17ece7 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.786540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:48.789798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 278/556] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:48.789957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:48.803641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.804211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.804736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.833929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:48.835299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:48.840842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 279/557] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:48.850192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.850552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 279/558] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:48.883186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e1f50-dd89-40ab-b8e1-fd317fc46fa4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.900869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:48.902020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:48.902565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:48.903118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:48.925082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:48.928505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:48.960967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 280/559] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:48.968064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.973443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:48.993398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f74a0-047f-42a6-a215-27aeb5782a9b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:48.993775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d9ff5-4bb4-4dad-be82-0da148ee7db4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.007146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.009105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929b47-932e-44c9-b9aa-a55bb9b344d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.010555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929b47-932e-44c9-b9aa-a55bb9b344d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.011051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929b47-932e-44c9-b9aa-a55bb9b344d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.011546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929b47-932e-44c9-b9aa-a55bb9b344d5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.013583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.014089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.014618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.038607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9929b47-932e-44c9-b9aa-a55bb9b344d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:49.044415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.048190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.049629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b9929b47-932e-44c9-b9aa-a55bb9b344d5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:49.052608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 281/560] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:49.054739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052a38d-c5b2-4be4-976d-cd533ae2d4c1 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.055274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052a38d-c5b2-4be4-976d-cd533ae2d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.055748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052a38d-c5b2-4be4-976d-cd533ae2d4c1 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.058035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 282/561] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:49.065046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.065622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.066105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.084733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:49.087030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 280/562] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.088158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.103198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:49.103403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897a14-5156-49eb-9160-222c5fb9eb04 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.105696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:49.108800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.109632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.109987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.110421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.111281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.111655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.113382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.121156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 283/563] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:49.123002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.125272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 281/564] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.148261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.151244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9cc6d-97b2-45b1-a5c5-ce44c117b3b3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.159373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.160532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.161015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.161498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.163002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.163538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.166627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.170355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ade6a-7336-4ea9-8c42-c014443761ad admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.179354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.180463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.180842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.181230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.191363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 284/565] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.192843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.202207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.205690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.214054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d11fe-0568-45d1-b64a-d58d59840817 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.226488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.227905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.228369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.228866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.229945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:49.233586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 282/566] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:49.234891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.259744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:49.267848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9d015-1648-4c32-a507-08759b1408e4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.274673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.275079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:49.275905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.276333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.276612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.277868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 285/567] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.279590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.289183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.293190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.301788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d73e-18b8-4597-b0dc-34921830a3e2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.310359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.311507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.311987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.312468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.313853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.314485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.317034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:49.317572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.318636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 283/568] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.323189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.339853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78337a-1604-47d0-8e52-56dc9ebd5907 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.346321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 286/569] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.347958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.359008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.360431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.360857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.361264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.363434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.364048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.366735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.367634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3360e-5471-4302-8c25-e65b46055ef3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.376517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.377880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.378357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.378783 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.380042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.380356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.381187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 284/570] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.382427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.382654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.397932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a5e60-cc44-476f-97e4-aa386f2b232c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.403297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.404220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 287/571] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.405579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.410804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.411081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.411412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.422180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a062-e961-4303-803e-376c6438a5ba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.424735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.427013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.430734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.431898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.432311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.432713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.443614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:41:49.445264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 285/572] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.446173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.457149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.461246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.465018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5009a3-df71-4c11-adbe-792d528098b2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.471761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.472428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.472711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.472980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.473842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=06999fb0772947f584d5608ca26f9352) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.474220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.476107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.484189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 286/573] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/role_assignments?user.id=06999fb0772947f584d5608ca26f9352&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.485154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.487530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-34d08004-652b-4ffe-ba04-813b1cf37d32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:49.500942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 288/574] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.502748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21228aed-2c5a-45b6-9ef4-8fbe9120ed39 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.503039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21228aed-2c5a-45b6-9ef4-8fbe9120ed39 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.503320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21228aed-2c5a-45b6-9ef4-8fbe9120ed39 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.504451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fc91d-4e36-4ee0-820e-5c86b9aa48a3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.505259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 289/575] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:49.506140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21228aed-2c5a-45b6-9ef4-8fbe9120ed39 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.510723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.512208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.513409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.513880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.515126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.515617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.517740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd116f1-5e53-4f0c-9e6b-d6c94acfc9b1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.521501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21228aed-2c5a-45b6-9ef4-8fbe9120ed39 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.526686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.527481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.527849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.528432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.529588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.529978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.532144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.546880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 287/576] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.550326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.551101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.551785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.553558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 290/577] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.554877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.572759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d10c8-4066-45d2-b0cc-e5c09b2fa351 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.579950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.581156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.581602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.582050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.586525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:49.592894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:49.594432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.596973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.607150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 288/578] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:49.608973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.623369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 15:41:49.624956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 291/579] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.635585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609047d-c151-4895-9cc3-e6722e8cb358 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.639258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.645040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.646271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.646829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.647374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.657538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a97c2-51c9-4431-816e-3b1db73d6d45 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.659927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.661861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.663332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.664387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.664818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.665282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.666362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.666922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.669254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.684978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 289/580] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:49.688222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.700205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c64a-f01a-4085-8f95-2efe972305a9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.702836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 292/581] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.704399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.711937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.712925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.713336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.713714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.722933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048b2bc-c3b5-493e-acd1-dcc5fb6cd0d1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.729098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:49.730983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.732747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.733498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.734550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.738060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:49.739600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 290/582] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.740656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.750324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.752616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.758681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad03ab7-bbde-4ccd-97ce-06781441d4ab admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.764684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.765821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.766315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.766813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.784846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.787346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:49.788509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.789436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 293/583] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.795296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.809128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7b80-e5af-4ac5-ba5a-fe5f158b0c38 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.817438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.818843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.818996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:49.819694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.820299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.820753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 291/584] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.821616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.822200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.822909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.826277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.840365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9aa82-9f7b-484d-9a20-c9c92f7a24ee admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.841597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 294/585] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.844467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.850428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.851623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.852147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.852606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.853656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.854075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.857459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.861047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46194e-b250-4c65-a322-93bfc9dd7ac8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.868125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.869139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.869585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.870985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.872340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.874818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.877019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.879771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 292/586] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.881467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.895466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fa8e8-e20e-44fe-a800-102296b7b7a9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.896943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 295/587] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:49.897835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.901055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.902050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.902470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.902888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.912644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d56bc-c20e-4a05-be75-a55c53fc77b7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.917493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.919830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.921050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.922402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.922816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.923260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.931974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.934032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.944965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:49.946499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 293/588] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.947244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.952602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:49.954249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 296/589] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:49.958847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644475f-bcba-4a0c-bf1c-8fc9c446b248 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.963844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.964802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.965198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.965633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.969012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:49.974666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.978016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:49.982140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8da107-8682-43ed-8af9-1338205410c8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:49.988653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:49.989504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:49.989882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:49.990333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:49.991220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:49.991627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:49.993733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.005957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:50.008422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 294/590] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:50.009731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 297/591] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.009970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.021240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.030530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286058a0-ae33-475b-a9c1-8c4f42361cea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.035865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0faaae-658c-4a50-8629-8cd534bfa9dd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.038069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.039973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.040920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.041747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.043602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.044406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.044682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.045600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.046126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.046681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.048068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.048947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.050194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.052232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.069034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 298/592] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.070832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.082215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 295/593] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.083226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29324d-487a-4e65-acfd-9bc182bff5b9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.086647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.089522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.090763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.091354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.091824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.102595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.104034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d65b0e-4322-4872-9ba3-b38db158b5d2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.105616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.112861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.114559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.115073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.115565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/025c8b235c244612932e1c931b40cf35/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.130771 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 15:41:50.133422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 299/594] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:50.139545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.148597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=025c8b235c244612932e1c931b40cf35, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.152926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.156661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384cde0-a034-4470-a589-10de21542bf6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.166222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.167564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.168104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.168744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.170764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=599ea3b3d1f5426ea3218ecb443ca0d0) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.171376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.175372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577fe4f-7014-4742-b864-7cc8ea7fd483 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.176190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 296/595] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:41:50 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/025c8b235c244612932e1c931b40cf35/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:41:50.177447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.197204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 300/596] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/role_assignments?user.id=599ea3b3d1f5426ea3218ecb443ca0d0&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.269667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af02e0-a409-44e0-93a2-2a79ca078f8e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.275136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.276763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.276955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bd8b7-de7f-48cf-aa7c-f45dde406732 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.277294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bd8b7-de7f-48cf-aa7c-f45dde406732 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.277803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bd8b7-de7f-48cf-aa7c-f45dde406732 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.277922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.278682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.280343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.281099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.283323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.287738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 301/597] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:50 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:50.298107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.299002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.299499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.306612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 297/598] 10.222.0.60 () {56 vars in 1158 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.314030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.326295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372535c4-9fbc-4a3b-bca2-07e33b6e22b4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.331684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.332800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.333322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.333836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.344880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.347825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.360067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:50.361159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 298/599] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:50.366410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:50.369272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.380689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e021a-fe12-42f9-9a61-3f2760427a94 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.387205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.388461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 302/600] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:50.389239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.389788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.390456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.404914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.407423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.430497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:50.432823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 299/601] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:50.440337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.455897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.461314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e6f5-5491-4817-be9d-fac36ca7a97d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.470086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ed5a-b01d-4bc7-86f6-7b5ca7966d4d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.478242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.479378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.480218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.480513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.482267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.483013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.485671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.488572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.489050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.489532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.490373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.521290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 303/602] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.522560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:50.526595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.539672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:50.553001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa077-1651-4d19-8663-90b125c48e0b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.553881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 300/603] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:50.557240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.570105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.571463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.571945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.572387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.582546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9b501-c80a-4f9e-89ab-18a5c6b25bbc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.589576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.590918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.591869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.592371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.592853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.593371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.594754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.595311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.597291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.618943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 301/604] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.625895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.626305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:50.631014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 304/605] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:50.642067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.642855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7a78-f6c9-49f6-9e40-7548926a29af admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.650047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.651515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.652005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.652553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.662631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90cea5-2d12-475e-81a7-e9ed4cea8162 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.667923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.668606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.669017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.669323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.670144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.670570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.671729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.672570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.675091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.691544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 305/606] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:50.702808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.709698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:50.711216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 302/607] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:50.718331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.720159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa651476-72f4-4a3d-bb1d-fd02da929c41 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.725857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.727153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.727526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.728002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.734203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=f74dc52500784e41bce60a945035ab74) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.734203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.734203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.743213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 306/608] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/role_assignments?user.id=f74dc52500784e41bce60a945035ab74&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:50.747362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61591935-10a3-464d-a561-9cc2436d3777 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.754878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.756123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.756665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.757099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.758306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.758791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.762057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.791137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 303/609] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:50.801571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.829817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324768-b8bc-4026-a42a-b7382e1f0dc2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.835078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.836156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.836591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.837209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.859807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.862425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.882524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 10 15:41:50.884197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 307/610] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/users/neutron => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:50.891800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.904448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5d32c-bba1-4180-a62d-e2ef0eb4bda0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.921112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.922145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.922631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.923054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:50.924477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:50.924943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:50.927185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:50.961398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 304/611] 10.222.0.60 () {56 vars in 1160 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:50.971168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:50.982626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6b34f-7500-4c58-91d1-760e88a9da70 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:50.995564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:50.996293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:50.996573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:50.997061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:51.008098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:51.011110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:51.029368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 308/612] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 10 15:41:51.039025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:51.058389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502923d3-9048-4fae-aaa7-15777c983a72 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:51.070490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:51.072138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:51.072783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:51.073397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:51.095827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:51.097983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:51.126121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:51.129162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 305/613] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:51.137212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:51.154958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fbfa-be3f-4a92-aad6-dca4e9da9d5d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:51.166815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:51.167511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:51.167792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:51.168108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:51.168943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:51.169247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:51.171120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:51.193056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 309/614] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:51.201652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:51.218140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82342f-964a-4156-97a9-cf43515e0fdd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:51.226529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:51.227596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:51.228034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:51.228446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:51.239229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:51.241503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:51.263114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:51.266030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 306/615] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:51.278316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:51.299907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711209bc-9d02-4e53-a9dc-e2e7c37b0814 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:51.314695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:51.316178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:51.316801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:51.317410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:51.319221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:51.319921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:51.323751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bac93-74f5-4de2-b52e-d73204484c91 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:51.343781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 310/616] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:51.350408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:51.363701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021acf6-a336-4a67-bd27-da5638d9efe5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:51.369461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:51.370881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:51.371503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:51.372096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:51.373016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=2ecc2dca57d045869f1fcf3a4337b990) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:51.373438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:51.375529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8921e-1bf3-4cd8-ba57-b457b7b741c6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:51.386517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 307/617] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:51 2021] GET /identity/v3/role_assignments?user.id=2ecc2dca57d045869f1fcf3a4337b990&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:52.936927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6124d7a-1b27-4fe1-a34b-0c460e85f692 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:52.937696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6124d7a-1b27-4fe1-a34b-0c460e85f692 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:52.937875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6124d7a-1b27-4fe1-a34b-0c460e85f692 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:52.940823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 311/618] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:52.948720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:52.949390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:52.949390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:52.979344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:52.980658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:52.992657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 308/619] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:53.043204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6124d7a-1b27-4fe1-a34b-0c460e85f692 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:53.061611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6124d7a-1b27-4fe1-a34b-0c460e85f692 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:53.069546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:53.070471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:53.070792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:53.071200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:53.096810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:53.098806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:53.121849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:53.123528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 312/620] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:53.129894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:53.144450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423684a-b13e-4a65-9ac4-2eabc4a294d8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:53.152523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:53.153340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:53.153605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:53.153885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:53.154697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:53.155115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:53.156874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eae61e-f135-46df-8f08-a6cf21dfa565 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:53.173586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 309/621] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:53.180162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:53.199163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff4a1e-533f-45a2-8aad-e7bcd905b4bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:53.215500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3535a-d4d6-4781-ac16-e497011becfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:53.216688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3535a-d4d6-4781-ac16-e497011becfb admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:53.217187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3535a-d4d6-4781-ac16-e497011becfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:53.217675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3535a-d4d6-4781-ac16-e497011becfb admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:53.218781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3535a-d4d6-4781-ac16-e497011becfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:53.221928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3535a-d4d6-4781-ac16-e497011becfb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:53.273711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 313/622] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:41:53 2021] POST /identity/v3/users => generated 254 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:41:53.986743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc72a-d74d-45cc-a508-b0bb7dc46aa8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:53.987488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc72a-d74d-45cc-a508-b0bb7dc46aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:53.987488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dc72a-d74d-45cc-a508-b0bb7dc46aa8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:53.989155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 310/623] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:53.997628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5efc7-f473-4587-87cf-8a77defd2f70 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:53.998337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5efc7-f473-4587-87cf-8a77defd2f70 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:53.998337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5efc7-f473-4587-87cf-8a77defd2f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.020250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f2b5efc7-f473-4587-87cf-8a77defd2f70 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:54.021692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f2b5efc7-f473-4587-87cf-8a77defd2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:54.035868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 314/624] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:54.065469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc72a-d74d-45cc-a508-b0bb7dc46aa8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.072117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4af18-1ffd-4ef6-bc57-4ea7448cb907 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.072613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4af18-1ffd-4ef6-bc57-4ea7448cb907 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.073114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4af18-1ffd-4ef6-bc57-4ea7448cb907 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.077471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 315/625] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:54 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:54.083563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dc72a-d74d-45cc-a508-b0bb7dc46aa8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.084950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.085553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.085994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.093432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.094805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.095121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.095400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.118924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:54.123722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:54.125209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:54.128817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:54.131509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 311/626] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.138792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.142224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 316/627] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:54.152887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf93003-d907-4950-8576-0fe708328da6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.158921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.159612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.159949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.160227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.161113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.161431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.163402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.174471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 312/628] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:54.189977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.191933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.207543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf27d86-59d0-4e05-a525-79c9c479e48a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.213693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548ee0d-9314-4cdd-9dff-0b6281302439 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.221349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.222731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.223204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.223722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.225749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.226642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.227194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.227496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.252248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.254595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.264695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:54.280999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:54.283795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 313/629] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.295724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:54.297739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 317/630] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.303397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.310682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.325806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85047ebb-70de-4da4-bbcd-2113cf58dd06 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.337749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.338482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.338759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.339031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.339571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1f03d-3ae0-4479-a6ca-cdf2da490f96 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.342579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.343340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.347626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.348992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.351348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.351794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.352192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.353249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.353720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.355623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.366600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 314/631] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:54.370522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.386302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 318/632] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:54.393610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18889e5a-3a9c-4e93-a785-9da8b5945811 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.394968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.409678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3deb0-3dc2-4ffa-aee2-6c0fc04e7417 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.416667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.418028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.419397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.419397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.425150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.426799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.427330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.427835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.439005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.441897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.442638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.445141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.463612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c6ff0a71-7724-4485-a03f-8f0ff9128096 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 15:41:54.464036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:54.465189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 319/633] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:54.466782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e177828-df0d-43af-9383-64a796f0353a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.467071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e177828-df0d-43af-9383-64a796f0353a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.467391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e177828-df0d-43af-9383-64a796f0353a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.467590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 315/634] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.475121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.475372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 320/635] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:54 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:54.475865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e177828-df0d-43af-9383-64a796f0353a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.489937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c50c-ffd2-4b19-92e7-52770c250bbd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.495800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e177828-df0d-43af-9383-64a796f0353a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.501653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.501653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.501653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.501653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.502213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.502213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.504404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93242b09-9f72-4dbf-b5e0-b8d266cbafdd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.509012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.509674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.509949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.510242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.510989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.511285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.513698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.540462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 316/636] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:54.540462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.540462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.540462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.544483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 321/637] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:54.552260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.565093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:54.566517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:54.570639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56282-3d0d-4ca1-9fe3-5ad82133fa8e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.577819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.579351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.580092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.580873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.582449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 317/638] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:54.583646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.596089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.600218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.603084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728a6e3-4749-4f1a-bfec-967893d65853 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.613691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.614665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.615062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.615410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.616263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 322/639] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:54.632027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.634847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.639030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.649535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb23d3-71d4-445c-a5ad-06d8c6c6479e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.658288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.660183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.661051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.661779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.663361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.665589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:54.665589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:54.665589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:54.665996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:41:54.668511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 318/640] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.668816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.670248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.687613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b046a-24c9-404f-89f8-8b5f79fc7861 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.694999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.696507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.697048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.697571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.699808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 10 15:41:54.706341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 323/641] 10.222.0.60 () {56 vars in 1150 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:54.708313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.720697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.720697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.735258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d08e3-0bec-4f88-b2d1-0b388e5686ba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.744551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.746112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.747011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.748086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.749725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.750596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.751277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:54.753413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 319/642] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.754521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.758865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.780160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c4cf1-6af9-4ffc-8933-f4b9125ac73a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.788012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.791113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.791915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.792179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.792814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 324/643] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:54.793870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.794490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.795488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.796524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:54.796524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:54.796524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:54.798752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.807841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 320/644] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:54.814476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.826866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284dcf-5635-4b7f-8849-7d4ea7592507 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.827657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5967a-a25e-4b61-8ed0-991baff9e417 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.831805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.832508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.833012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.833519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.837752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.839561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.841780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.842698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.844341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.845167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.846003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.846286 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.849718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.859323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 321/645] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:54.860443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.877789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059890b1-f9a6-4e2f-a7c9-0ed6778e8c98 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.880086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 325/646] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:54.881562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.890895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.892096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.892587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.893095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.894428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:54.894925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.897354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.903642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188385e-00d7-4ee0-839c-c9146e7af0f2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.905623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 322/647] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:54.906791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.911440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.912781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.913260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.913722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.922340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69610c9-026a-40ab-92d9-44491059944f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:54.929195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:54.930430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:54.930892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:54.931326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:54.935142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.939255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.942776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:54.946054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:54.970113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:54.970799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:54.971976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 323/648] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.973775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 326/649] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:54.980377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.984781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:54.995570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73ab95-b986-4bb4-9278-ced187396d30 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:55.002596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:55.002902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d5d25-4bf6-4589-80ae-d428b4523685 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:55.003559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:55.003899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:55.004324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:55.005509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:55.005802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:55.008877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:55.012529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:55.014114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:55.014984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:55.015761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:55.017489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:55.018346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:55.021478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:55.031854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 324/650] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:55.038960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:55.052124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e2f71-519d-4769-881e-bdf7fa61ce2e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:55.058593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:55.059381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:55.059658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:55.060073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:55.061291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=025c8b235c244612932e1c931b40cf35) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:55.061878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:55.063758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 327/651] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:55.070205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:55.074068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:55.075515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 325/652] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:55 2021] GET /identity/v3/role_assignments?user.id=025c8b235c244612932e1c931b40cf35&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:55.100112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450cb8f-85ef-48a1-8aef-aa94187045a0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:55.117640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:55.119511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:55.120329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:55.121051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:55.140352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:55.144320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:55.165688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:55.167483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 328/653] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:55.177643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:55.196339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b883-df94-45c2-bfe4-3db0043044f2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:55.218542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:55.219704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:55.220218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:55.220662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:55.227493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:55.227931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:55.229873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0cd9-8d93-4f2d-83d5-59f82fc275c8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:55.273287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 326/654] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:55.284069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:55.308207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95764b2-ce03-4ce1-8d7a-d87e450c3fc8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:55.322998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:55.324056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:55.324526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:55.325074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:55.326626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=599ea3b3d1f5426ea3218ecb443ca0d0) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:55.327154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:55.329953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1f5e-a4f4-4235-8e8e-14eb325d8849 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:55.347532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 329/655] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:55 2021] GET /identity/v3/role_assignments?user.id=599ea3b3d1f5426ea3218ecb443ca0d0&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:56.095815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43dc6f-8365-4323-8b39-bcc57d44f857 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.096669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43dc6f-8365-4323-8b39-bcc57d44f857 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.096669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43dc6f-8365-4323-8b39-bcc57d44f857 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.098726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 327/656] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:56.112219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.112869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.112869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.143326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:56.144562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:56.159648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 330/657] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:56.207962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43dc6f-8365-4323-8b39-bcc57d44f857 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:56.229405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43dc6f-8365-4323-8b39-bcc57d44f857 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:56.245558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:56.246457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.246810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.247131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.247794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:56.248914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:56.248914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:41:56.248914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:41:56.249829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:56.268408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 10 15:41:56.269980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 328/658] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:56 2021] GET /identity/v3/services/network => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:56.279171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:56.292704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03603556-c550-4065-934b-5a5a79c7b387 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:56.302973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:56.304027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.304334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.304615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.305395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:56.305721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:56.306813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:56.306813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:56.306813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:56.308179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc014-c423-45cb-b18c-4218604b0b7c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:56.316259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 331/659] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:41:56 2021] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:56.324509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:56.344905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f1551-9d90-4062-866a-66844e5cafb8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:56.354341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:56.355242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.355537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.355815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.357182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:56.357499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:56.359436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72161dc-2602-4f89-8eb8-e970f1955c89 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:56.365549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 329/660] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:41:56 2021] GET /identity/v3/services?type=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:56.928355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5923d9-dd02-46eb-abbb-3830d1787e3e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.928355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5923d9-dd02-46eb-abbb-3830d1787e3e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.928355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5923d9-dd02-46eb-abbb-3830d1787e3e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.928355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 332/661] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:56.935159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:56.935444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:56.935713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:56.963378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:56.964637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:56.989250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 330/662] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 10 15:41:57.027349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5923d9-dd02-46eb-abbb-3830d1787e3e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.052339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5923d9-dd02-46eb-abbb-3830d1787e3e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.057692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.058911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.059679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.059981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.084485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:57.092372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:41:57.094029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 333/663] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:57.103573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.119971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3216197-7d8d-40b4-ad10-20735f83f204 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.132469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.133640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.134114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.134603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.135614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:57.136131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.138071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.159579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 331/664] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:57.165861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.177121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339ad81-71d9-4325-8c3a-86c1612ea020 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.195390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.196484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.196913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.197331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.220919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.222979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.253717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:57.255282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 334/665] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:57.266010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.284750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16dc92-1042-4d19-8c7b-4e601fdeae4f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.301620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.303106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.303880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.304668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.306444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:57.307254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.316232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.351854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 332/666] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:57.358775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.372977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491bb0-c514-47ae-b89f-2951cbf1e563 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.392041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.392887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.393170 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.393449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.411895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.415946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.455334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 15:41:57.462873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 335/667] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:57.470153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.493419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633139a7-497e-4720-9e72-3c423e0e4337 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.512344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.513567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.514085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.514612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.515731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:57.516275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.518458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.566306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 333/668] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:57.576125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.599641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd6075-965b-497f-954a-151950c99abe admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.608480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.609855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.610375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.610825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.632015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.643307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.664759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 336/669] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:41:57.670800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.702672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6593b19-e31f-4af6-a59b-e24b5567f608 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.719365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.720602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.721074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.721735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.742987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.746050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.769895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:57.772129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 334/670] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:57.781406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.800540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187762fb-1534-4544-be9a-6adc996b8734 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.811065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.811770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.812058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.812330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.813101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:57.813408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.815213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.833662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 337/671] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:57.843706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.858746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356146-7dca-46f1-9446-2f78b773258c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.871340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.873308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.874031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.874801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.884504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.886971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.913782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:41:57.916766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 335/672] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:57.927432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:57.950566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f91b7-5594-4d60-8a68-109e4a1ba3cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:57.960268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:57.961319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:57.961730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:57.962151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:57.963469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:57.963939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:57.967052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3b424-8c84-4b3d-9138-2b5845dcd05e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:57.993310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 338/673] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:41:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:58.004041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:58.023285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eeda0-8f73-445b-8a71-e5e067b8985b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:58.031929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:58.032680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:58.033159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:58.033479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:58.034647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=c57ea6e1a68f45e98ebaf2804cde1337) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:58.034967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:58.037281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2c56-5af1-476e-a70a-cf99ed09adb1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:58.052728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 336/674] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:41:58 2021] GET /identity/v3/role_assignments?user.id=c57ea6e1a68f45e98ebaf2804cde1337&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:58.504497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb183f-6124-4dd9-9171-2da3a52a2e97 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:58.505275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb183f-6124-4dd9-9171-2da3a52a2e97 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:58.505275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb183f-6124-4dd9-9171-2da3a52a2e97 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:58.508920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 339/675] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:58.519298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293390-c104-4bdf-9528-db8c74c60c1b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:58.520055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293390-c104-4bdf-9528-db8c74c60c1b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:58.520223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293390-c104-4bdf-9528-db8c74c60c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:58.555637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-62293390-c104-4bdf-9528-db8c74c60c1b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:58.557608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-62293390-c104-4bdf-9528-db8c74c60c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:58.581258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 337/676] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 10 15:41:58.659724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb183f-6124-4dd9-9171-2da3a52a2e97 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:58.685313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb183f-6124-4dd9-9171-2da3a52a2e97 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:58.695405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:58.696277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:58.696586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:58.696857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:58.697621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:58.698820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:41:58.698820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:41:58.698820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:41:58.699797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b63a4-0534-466f-9000-2f40e0dc2ccc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:58.725820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 340/677] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:41:58 2021] POST /identity/v3/services => generated 251 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:41:59.274131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4045-0dff-45e7-bd7c-9185598673fc None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.274568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4045-0dff-45e7-bd7c-9185598673fc None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.274812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4045-0dff-45e7-bd7c-9185598673fc None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.277190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 338/678] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:41:59.288387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.288687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.288994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.316431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:59.317743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:59.319023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87416-23cf-4036-aa8d-4a9cc2c85aab None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.319461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87416-23cf-4036-aa8d-4a9cc2c85aab None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.319901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87416-23cf-4036-aa8d-4a9cc2c85aab None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.323466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 339/679] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:41:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:41:59.334473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.334901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.335310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.352317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 341/680] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:59 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:41:59.366945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:41:59.368170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:41:59.377021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 340/681] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:41:59 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:41:59.390248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.399907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b267-f5d0-4f15-820a-b2d9f466cbaf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.407296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.408124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.408401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.408676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.423573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:59.427188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.432212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:59.434695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 342/682] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:59.442795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.449451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a24fc-79de-436f-bf80-eeec7631ba35 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.456120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7cae-79bf-4585-9a6d-06246ece54e7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.461497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.462683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.463293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.463915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.464764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.465205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:59.465713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.466011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.466110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.466554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.468699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.481814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 343/683] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:59.492072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.504470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599190-f5ed-4a13-bee3-77d510a42c88 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.507505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:41:59.510520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.511425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.511703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.512028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.515439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:41:59.522736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 341/684] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:59.525931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.527948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.533391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.548492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:59.554991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 344/685] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:59.559392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.562506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6396b-aa51-438c-9e4d-425b0436b049 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.580700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.582869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.584819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.585118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.587084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1738fa2-3a7e-4616-b0cd-56448c414023 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.588027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:59.588353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.592879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.597268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.597945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.600849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.601139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.601923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:59.604064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.608254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.615136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 342/686] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:59.627292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.630780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 345/687] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:59.632691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.645195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23740-c5c5-4cea-88a6-efcdefc8fed4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.651048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.651936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.652212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.652535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.654533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c49704-deea-466a-b643-9b49f9abe287 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.663672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.666302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.675128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.676540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.677024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.677494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.684891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 15:41:59.696545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 346/688] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:41:59.705089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.707272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.710556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.729867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720fe88-cade-4fb2-bd44-063dc42265bd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.745032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.746945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.747670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.748262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.749782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:59.750569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.753705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.766285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:59.766285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 343/689] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:59.772095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.802246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 347/690] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:41:59.803763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.803990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e74b3-d479-481f-beb7-75ab7ed33114 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.814881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735de4a-8f7a-45bd-bd2e-a25b5c474d7d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.822116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.823423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.824030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.824502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.832363 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.833523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.834019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.834537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.835970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:59.836365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.836497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.839824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.847996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.857225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 348/691] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/auth/tokens => generated 1018 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:41:59.860804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.872748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933cf00-6082-4b6c-89b5-552344cd7819 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.880012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.880868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.881149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.881419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.890831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 344/692] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:59.895178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.897042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.901600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.927755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:41:59.933907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 349/693] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:41:59.939502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:41:59.941787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8020-defc-437f-9b70-0ed34f195c56 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.959336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b15ee4-6b1c-4dd4-92bd-2a8789353392 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:41:59.966421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.967312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.967589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.967919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.968892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:41:59.969410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.971443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:41:59.972059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.972864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:41:59.973371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:41:59.973859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:41:59.993857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 350/694] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:41:59.995578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:41:59.998385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:41:59.999479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.014553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9ad1-88a6-417d-9566-85c39d1248ce admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.020912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.020912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.020912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.021335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.029735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.031811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.046720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:42:00.047704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:00.049438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 345/695] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:00.054428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 351/696] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:41:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:00.058126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.060176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.072961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4876cbc-1c27-493b-8241-991d25b00f15 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.079097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.080164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.080638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.081131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.081817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8fb87-7940-4cc1-a780-f5cfb05845ba admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.083362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:00.084223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.091619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.107368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.108053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.108329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.108600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.109428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:00.109733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.111685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.118449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 352/697] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:00.128245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.142123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 346/698] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:00.151048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.153807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866e9b8-896b-4f97-b18c-8281ab98690e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.163440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.165700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.168581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.169450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.180115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0b28-baf6-4066-b18b-f1ef2101acff admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.197171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.200484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.203018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.204851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.206021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=025c8b235c244612932e1c931b40cf35) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:00.207326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.208453 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.210705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.213145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.227282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 347/699] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/role_assignments?user.id=025c8b235c244612932e1c931b40cf35&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:00.243612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:00.245211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 353/700] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:00.251988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.273925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2865-0c5b-4e25-8850-b6f0a03bf823 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.284634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.285399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.285680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.285955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.286834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:00.287321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.290624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.322765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 348/701] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:00.328946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.344824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65a6b-6c63-4181-886e-064de22adf56 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.360640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.361451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.361724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.361994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.374637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.376644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.402642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-391c04b5-15f6-45d5-b506-6b8dacc163c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:00.409947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 354/702] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:00.411903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.443109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283907ce-078b-4f6f-9d4f-70603a8348f9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.458968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.464589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942fb11-51bb-4d6a-9b1d-2904bafe0add None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.464879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.465006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942fb11-51bb-4d6a-9b1d-2904bafe0add None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.465744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942fb11-51bb-4d6a-9b1d-2904bafe0add None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.466629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.467417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.469187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 355/703] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:00.469520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:00.470381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.474228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.474947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.475414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.475894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.504586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 349/704] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:00.514606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.533103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:00.536010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:00.545424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427d999-8dce-4f96-9128-8f51a19bc55d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.558454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345203e9-0d24-447a-9ee5-d5de8efcca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.560025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345203e9-0d24-447a-9ee5-d5de8efcca4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.560805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345203e9-0d24-447a-9ee5-d5de8efcca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.561432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345203e9-0d24-447a-9ee5-d5de8efcca4e admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/599ea3b3d1f5426ea3218ecb443ca0d0/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.564366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 356/705] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:00 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:00.565081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345203e9-0d24-447a-9ee5-d5de8efcca4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=599ea3b3d1f5426ea3218ecb443ca0d0, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.568901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345203e9-0d24-447a-9ee5-d5de8efcca4e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.600105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 350/706] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:00 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/599ea3b3d1f5426ea3218ecb443ca0d0/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:42:00.621602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:00.636527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042082b-5d78-4656-a90e-1a9cd350649f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:00.731524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614da01-52f4-44dc-8fff-92bfe499771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:00.732288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614da01-52f4-44dc-8fff-92bfe499771d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:00.732626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614da01-52f4-44dc-8fff-92bfe499771d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:00.732907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614da01-52f4-44dc-8fff-92bfe499771d admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:00.733827 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614da01-52f4-44dc-8fff-92bfe499771d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:00.735739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614da01-52f4-44dc-8fff-92bfe499771d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:00.756164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 357/707] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:00 2021] POST /identity/v3/services => generated 240 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:01.542734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b4adb-7c96-4f42-becc-07a084251264 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:01.543395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b4adb-7c96-4f42-becc-07a084251264 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:01.543901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b4adb-7c96-4f42-becc-07a084251264 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:01.545924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 351/708] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:01.553313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:01.553801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:01.553903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:01.583373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:01.584636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:01.609849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 358/709] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:01 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:01.648449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b4adb-7c96-4f42-becc-07a084251264 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:01.672816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b4adb-7c96-4f42-becc-07a084251264 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:01.684053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:01.685383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:01.685859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:01.686373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:01.706080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:01.713475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:42:01.723186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 352/710] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:42:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:01.733091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:01.749652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6ebc-caa9-49df-9d43-0ef57cdd6e4e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:01.759338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:01.760030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:01.760314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:01.760760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:01.761774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:01.762296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:01.765444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:01.786780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 359/711] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:42:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:01.800027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:01.830908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee199d1-553c-4336-9f2b-ce409822d4a6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:01.845732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:01.847616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:01.848413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:01.849171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:01.879802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:01.887220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:01.921033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:01.924600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 353/712] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:01.935361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:01.956096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38248f-bf16-42de-8d76-143c4c15f8a5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:01.962911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:01.963595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:01.963914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:01.964189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:01.964965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:01.965295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:01.967449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:01.990406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 360/713] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:01.997189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.012490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d842-683a-4005-8261-caeb57afc6e7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.022924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.024149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.024623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.025095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.034857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.037440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.057469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 15:42:02.059673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 354/714] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:42:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:02.067257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.090104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184d626-b8b7-4312-8d64-d36b6cfb6a58 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.103592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.104329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.104616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.104904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.106142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:02.106510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.108644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.142413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 361/715] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:02.150419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.170203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2154be1-967c-44e9-bc05-d65a5e59824e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.188237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.190068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.190954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.191691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.234088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.236372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.265355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:02.267392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 355/716] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:02.275616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.310971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c058f-7889-45c1-8c31-24529f53d1e6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.328911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.329909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.330361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.330774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.331991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:02.332508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.335185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.354499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 362/717] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:02.361420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.382207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3ed4b-354f-4644-a38b-88b3b71d9ffd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.389397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.390571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.391045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.391490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.406562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.408997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.425760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:02.427893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 356/718] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:02.435533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.462433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed1e8-29af-4d5d-a8ee-86c857052c67 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.470768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.471642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.472032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.472427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.473440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:02.473923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.476293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614ecd9-bdfe-4096-b32c-0d278445aaa7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.500787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 363/719] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:02.510830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.530190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152efce-492d-43a8-ab54-25daa7c962ff admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.536164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.537362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.537783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.538281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/c57ea6e1a68f45e98ebaf2804cde1337/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.571199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=c57ea6e1a68f45e98ebaf2804cde1337, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.573715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a08ee-4e70-4a81-8cd0-e1c7bf5b2fb4 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.574325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a08ee-4e70-4a81-8cd0-e1c7bf5b2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.574483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a08ee-4e70-4a81-8cd0-e1c7bf5b2fb4 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.580342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 364/720] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:02.587887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.588331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.588836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.591437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.615733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 357/721] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:02 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/c57ea6e1a68f45e98ebaf2804cde1337/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:42:02.632962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:02.634582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:02.735762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 365/722] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:02 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:02.811376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.826535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb427-e6ec-4c4a-83bc-c02e2ebf627f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.838988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.839830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.840105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.840442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.841521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.843237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.860244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 10 15:42:02.869706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 358/723] 10.222.0.60 () {56 vars in 1150 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:02.871934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.890824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75530-08a8-42ae-9adc-ad842c7132c1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.907114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.908078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.908504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.908925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.909845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:02.910338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.912139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.917722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 366/724] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:02.925336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.937638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5278a6-1670-4e5c-86e4-ec94179f972c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.951592 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.952299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.952586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.952859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.953726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:02.954043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:02.955926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:02.962217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 359/725] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:02.971103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:02.988931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35268db-1d6f-4e92-ae46-9a0d72f459b8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:02.994725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:02.996209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:02.996931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:02.997483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:02.998799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] RBAC: Adding query filter params (interface=public, service_id=44220d7dcf9644fba362672d3cba3f74, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:02.999324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.000712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:03.000712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:42:03.000712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:42:03.002039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f2c13-f0ed-4658-9f96-b004f45f833a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:03.011897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 367/726] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:02 2021] GET /identity/v3/endpoints?service_id=44220d7dcf9644fba362672d3cba3f74&interface=public®ion_id=RegionOne => generated 194 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:03.018980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.039457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3905-cf65-4810-85b4-68efc5434422 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.050857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc92f-4566-4c68-9e9e-de6b5bc9bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.051559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc92f-4566-4c68-9e9e-de6b5bc9bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.051839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc92f-4566-4c68-9e9e-de6b5bc9bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.052113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc92f-4566-4c68-9e9e-de6b5bc9bbd1 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.052874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc92f-4566-4c68-9e9e-de6b5bc9bbd1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.054868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc92f-4566-4c68-9e9e-de6b5bc9bbd1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:03.063125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 360/727] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/services => generated 772 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:03.493298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead9e8-cf39-44c0-a6f4-37cfb0c5e7e3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.493571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead9e8-cf39-44c0-a6f4-37cfb0c5e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.493767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead9e8-cf39-44c0-a6f4-37cfb0c5e7e3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.496190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 368/728] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:03.506619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.507015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.507155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.530058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:03.531303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:03.539825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 361/729] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:03 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:03.569325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead9e8-cf39-44c0-a6f4-37cfb0c5e7e3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.585747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead9e8-cf39-44c0-a6f4-37cfb0c5e7e3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.591293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.592141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.592420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.592725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.609730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:03.617486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:42:03.619107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 369/730] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:03.628947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.650035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510963-fe1c-44c9-b3ad-89176a717ae6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.663707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.665280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.665965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.666656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.668144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:03.668974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.671971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:03.696194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 362/731] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:03.724269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.739881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98053419-9193-4a1a-9f48-8a7d6a57a231 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.748914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.749784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.750073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.750382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.767758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.769990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:03.804817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:03.806474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 370/732] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:03.813311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.823967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ab709-b8a4-4424-b0c5-b23b1f0b61e8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.829902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.831093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.831615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.832085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.833136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:03.833644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.835724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c93b-53ee-4542-a543-b892c0f61342 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:03.850993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 363/733] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:03.858510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.869035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f0deb-7029-4dc7-865e-ac46cfc65457 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.878906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.879735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.880021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.880289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.885897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf97a5-2449-4f57-85a0-9a84a5f34422 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.886634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf97a5-2449-4f57-85a0-9a84a5f34422 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.887245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf97a5-2449-4f57-85a0-9a84a5f34422 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.889562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 364/734] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:03.899883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.902484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:03.906926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.907277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.907557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.935989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 15:42:03.939851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 371/735] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:03.944392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:03.946323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:03.952521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:03.965510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 365/736] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:03 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:03.974203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88da1ed-3a64-40b2-bbc5-2dfb8a5855b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:03.977663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:03.982196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:03.982196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:03.982196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:03.982196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:03.982196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:03.986216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.023547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.047272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 372/737] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Nov 10 15:42:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:04.051361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2f0c-faa2-42e3-b96f-25c7ccd4e1f0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.058693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.060723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.062379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.063697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.064981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.079370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d6e8-3005-4770-ab67-7b9dcda1140b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.084413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.085764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.086274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.086737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.099035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.101490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.107245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:04.114234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:42:04.115840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 366/738] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:04.124826 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.128846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:04.130754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 373/739] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:04.137815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.144642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f567-0673-4bb7-8ce2-629686c77c2a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.148042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94653-1d0e-4030-a4f0-e2d70a63ec90 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.154499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.155586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.155866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.156572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.157359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.158272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.159343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.160026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.160349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.160622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.161874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.162338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.166602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.168601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.200084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 367/740] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.204181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 374/741] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.212844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.222965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.236021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5565d8-f687-4f8e-9569-7c51d64f780e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.237232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93c38e-03af-4682-838b-e7ad9d74c7ed admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.250145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.251647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.252169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.252641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.265465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.266269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.266950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.267459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.267970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.269247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.289940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:04.291908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 368/742] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:04.299273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.301091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.305215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.311205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15c84-4152-4c01-bf95-ae043aecafb6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.317084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.318473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.319044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.319623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.321312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.321881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.323972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.339266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 369/743] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:04.344163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:04.345754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 375/744] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:04.347187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.352728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.359572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0f43-1a2a-44ae-9976-30e6329bf9b4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.364747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.365955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.366520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.366993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.368391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce747-f68e-4ec0-b5b2-7f5720560854 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.377580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.380378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.394999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.395692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.395975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.396245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.397143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.397455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.397741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:42:04.399398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.400173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 370/745] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:04.411604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.421631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 376/746] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.429053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.430703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a8a3a-dba8-4875-bfbd-b6902d04b4da admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.437680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.438828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.439311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.439797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.441101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.441639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.443948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.444828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa95ba8-b68b-402d-adc5-a872332c8865 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.468271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 371/747] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:04.473446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd24d-9ad4-43fa-8781-78810bfacb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.473446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd24d-9ad4-43fa-8781-78810bfacb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.473446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd24d-9ad4-43fa-8781-78810bfacb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.473446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd24d-9ad4-43fa-8781-78810bfacb5e admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/025c8b235c244612932e1c931b40cf35/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.474865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd24d-9ad4-43fa-8781-78810bfacb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=025c8b235c244612932e1c931b40cf35, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.475819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.479588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd24d-9ad4-43fa-8781-78810bfacb5e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.486838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ce6f-1d30-4049-98f3-6ef600b21fe8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.492003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.492973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.493534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.494091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.508556 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 377/748] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:04 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/025c8b235c244612932e1c931b40cf35/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:42:04.510248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee31de7-c2e5-499d-9d68-32bae2e8d2ca None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.510647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee31de7-c2e5-499d-9d68-32bae2e8d2ca None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.510832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee31de7-c2e5-499d-9d68-32bae2e8d2ca None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.512436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.516209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.518354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 378/749] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:04.520733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.521045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.521289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.530931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 372/750] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:42:04.538577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.549771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b81d4-bf00-4511-9f8b-1bcb375726eb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.551931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:04.553561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:04.629093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.631178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.631873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.632478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.638269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 379/751] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:04 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:04.660318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.662824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.671607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.675389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f13913-7fd7-4a05-bf1f-5b19b4ae7e9c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.689297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.690822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.691380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.691932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.693273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.697987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.712030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:04.720133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 373/752] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:04.727705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 10 15:42:04.729717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 380/753] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/services/network => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:04.731637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.738624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.750983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1f62-7a3b-4c5d-864c-e3b211ef2e66 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.758474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.759357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.759686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.759943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.760703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.761127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.763083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.763534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b97f-e3d1-4ad4-a9f9-b156d9353558 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.774460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 381/754] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.775896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.780703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.781844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.782398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.782863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.783826 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.784329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.787092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.787367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc76cb-8281-4e1c-9810-5744f635c7a0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.801979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.802656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.802990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.803311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.806959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.807402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.811282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.821913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 374/755] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:04.830931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.831382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 382/756] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/services?type=network => generated 350 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.835299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.841895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3a8a5-76ba-4e12-8ab1-d82dd749813b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.847653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc78b4-3d42-4604-a93b-bad3985db005 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.848155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.849157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.849540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.849813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.852810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.853721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.854011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.854340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.855236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] RBAC: Adding query filter params (interface=public, service_id=8d1a47883a1c4cd1a99410b921c0b95d, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.855549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.857578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.857910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.860726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.868398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 383/757] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/endpoints?service_id=8d1a47883a1c4cd1a99410b921c0b95d&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:04.875381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.876749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:04.878364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 375/758] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:04.888551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16838-1fc9-45ad-90d5-8a29033aef0a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.890961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.894404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.895197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.895569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.895913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.896775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.898683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.906198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd463ab-bc8b-477f-a75f-7d690d92197f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.909319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 384/759] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.911906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.913110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.913569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.913940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.915032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.915476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.917741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24efcf-816f-4a90-966d-59bb0927190a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.938386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 376/760] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:04.942402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:04.959723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26992eb-d8c3-43fe-be11-02dac70f90d2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:04.968648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:04.969523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:04.969927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:04.970331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:04.971386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=599ea3b3d1f5426ea3218ecb443ca0d0) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:04.971783 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:04.974421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88c938-051c-4475-86eb-c27f9e2c29be admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:04.986389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 385/761] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:04 2021] GET /identity/v3/role_assignments?user.id=599ea3b3d1f5426ea3218ecb443ca0d0&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:06.086744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b3d5-fab5-479a-8e27-85b8dbf0b9d8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.087582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b3d5-fab5-479a-8e27-85b8dbf0b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.087582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b3d5-fab5-479a-8e27-85b8dbf0b9d8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.089367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 377/762] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:06.096436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.097401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.097401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.121718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:06.122991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:06.133989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 386/763] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:06.181734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b3d5-fab5-479a-8e27-85b8dbf0b9d8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.200541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b3d5-fab5-479a-8e27-85b8dbf0b9d8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.205814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.206734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.207016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.207293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.224344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:06.232127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:42:06.233807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 378/764] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:06.243615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.254069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7cbb2-9305-47b9-9cc4-ceb529075969 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.264868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.265592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.265890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.266189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.267051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:06.267357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.269018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de899-e323-4344-9a75-b3e2d2d8e166 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.279993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 387/765] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:06.285984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.302606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ca012-3c69-4439-b217-b1c2dad04378 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.307639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.308963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.309416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.309848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.331702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.334835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.347848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d12c-a5bb-448d-b79c-eef2464bf8a6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.348027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d12c-a5bb-448d-b79c-eef2464bf8a6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.348409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d12c-a5bb-448d-b79c-eef2464bf8a6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.350745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 388/766] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:06.358768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.359074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.359337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.370080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:06.372551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 379/767] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:06.378905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.395915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2277a69-7399-494d-9176-f0eb1b204776 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.398890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:06.400164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:06.406709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.407406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.407778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.408142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.409019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:06.409338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.412480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.430196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 389/768] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:06.440362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 380/769] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:06.447079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.457998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc675-ab50-42b8-8494-884c9129debe None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.461865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.474363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.475560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.476044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.476516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.486078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a78cb4-cdd0-428c-a553-f1ef24d9f559 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.498918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.501354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.502843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.503295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.503733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.504731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.504923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.506952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.522570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 10 15:42:06.524704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 381/770] 10.222.0.60 () {56 vars in 1150 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:06.533888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.548824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d91cf-2fd1-451d-bf4e-db3ec7d60dc7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.549798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 15:42:06.551589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 390/771] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:06.558588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.563156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.564288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.564909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.565712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.567920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:06.568680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.571715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.582949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 382/772] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:06.588015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726d9ef-a945-4926-b6c8-007ec3f9f89d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.596814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.597048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.597985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.599182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.599182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.600487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:06.601035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.604522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.617623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093082e9-f4f6-41f2-b8f6-ab7a07a37440 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.639107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.639806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.640088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.640390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.641120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:06.642280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.643150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.651036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 391/773] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:06.657796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 383/774] 10.222.0.60 () {56 vars in 1145 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:06.663651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.667661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.683730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc55635-3d22-441c-ac20-7184d5ee848c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.688504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcc66-c6a5-4431-91ac-2a5743b946be admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.698049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.698772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.699027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.699310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.700605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.701229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.701505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.701777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.702607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.703644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:06.703644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:42:06.703644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:42:06.704540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.717948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.719838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.737407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 392/775] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:42:06.751743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 384/776] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:06 2021] POST /identity/v3/endpoints => generated 346 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:42:06.754395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.766148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce54036-9441-431f-9667-ae815792b7d6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.793615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.794544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.794843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.795128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.818032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.822650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.849047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:06.855853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 393/777] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:06.861159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.899905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc853b-b44f-45ff-b2cb-2c9d4de9157f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.910127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.911165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.911593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.912014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.913210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:06.913684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.916272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:06.939473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 385/778] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:06.950452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:06.967532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557bf8-c8d8-4110-8a2d-e8007609790b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:06.979231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:06.980172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:06.980552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:06.980949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:06.991631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:06.993809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:07.014080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:07.015862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 394/779] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:07.026903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:07.045197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623964ff-69a1-4219-a1ed-e90127d7702c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:07.059191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:07.059926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:07.060204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:07.060479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:07.061328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:07.061638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:07.063617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed0a35-2436-4f5b-9fa3-45801fa70769 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:07.086851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 386/780] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:07.098087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:07.121622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96add178-d49f-41bb-aefa-204057ca0512 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:07.133876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:07.134924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:07.135354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:07.135769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:07.137396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=c57ea6e1a68f45e98ebaf2804cde1337) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:07.137901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:07.140993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f896a2-d66f-4724-ad2d-9aae3e8e08d2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:07.152465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 395/781] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:07 2021] GET /identity/v3/role_assignments?user.id=c57ea6e1a68f45e98ebaf2804cde1337&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:08.060470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86947-87ee-41fd-8d44-e6ee42cfec78 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.060990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86947-87ee-41fd-8d44-e6ee42cfec78 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.061465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e86947-87ee-41fd-8d44-e6ee42cfec78 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.065418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 387/782] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:08 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:08.076848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ecd6-0aa7-4d1f-9486-89ce7c8a1e9f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.077346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ecd6-0aa7-4d1f-9486-89ce7c8a1e9f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.077830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ecd6-0aa7-4d1f-9486-89ce7c8a1e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.116281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3d40ecd6-0aa7-4d1f-9486-89ce7c8a1e9f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:08.118416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3d40ecd6-0aa7-4d1f-9486-89ce7c8a1e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:08.138885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 396/783] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:08 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:08.186313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86947-87ee-41fd-8d44-e6ee42cfec78 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.214180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e86947-87ee-41fd-8d44-e6ee42cfec78 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.225658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeb7fd-d3fe-45db-8ce7-ee20c8c65e0d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.226040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeb7fd-d3fe-45db-8ce7-ee20c8c65e0d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.226257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdeb7fd-d3fe-45db-8ce7-ee20c8c65e0d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.228500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 397/784] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:08.234145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.235323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1999-8e94-47cf-ba0b-adb8c1464713 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.235582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.235679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1999-8e94-47cf-ba0b-adb8c1464713 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.235956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1999-8e94-47cf-ba0b-adb8c1464713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.236051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.236553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.266551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:08.274253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:42:08.278567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 388/785] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:08.282747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-55ee1999-8e94-47cf-ba0b-adb8c1464713 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:08.283989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-55ee1999-8e94-47cf-ba0b-adb8c1464713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:08.287236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.300704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 398/786] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:08 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:08.303040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d927-c3e1-4d62-b8a0-c769a6e96fb5 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.303560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d927-c3e1-4d62-b8a0-c769a6e96fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.304073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d927-c3e1-4d62-b8a0-c769a6e96fb5 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.306823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 399/787] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:08.309772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a465-82e1-431f-92e9-3f23e6334fdb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.314770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.315309 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.315780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.322180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.322180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.322180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.322180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.322516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.322516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.322657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.333429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 389/788] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.342441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.349630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:08.351556 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:08.353085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f18503-6aa2-4d05-855e-98c910aeac53 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.359139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.359973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.360257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.360537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.361246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.361856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 400/789] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:08 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:08.370535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.370734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.393019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 10 15:42:08.393254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09d27b-41c4-4586-8281-1a0b8e759d04 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.395187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 390/790] 10.222.0.60 () {56 vars in 1153 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:08.396247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.406715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.407768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.408138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.408249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d76e0-93a0-4a32-91fc-9dadc004c372 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.408573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.413748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.414824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.415243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.415652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.416527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.418948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.422257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.424844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.433960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 10 15:42:08.436503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 391/791] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:08.437542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.447835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908461-6ba4-4b27-9cf4-9e7e3628498a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.450821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:08.453203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 401/792] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:08.454196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.462907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.463754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.464146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.464512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.465855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.466146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.467980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.470379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298dcf-9ed7-4d98-bfba-c25df17e32d7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.473578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 392/793] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.479229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.485110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.486354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.486914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.487399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.488791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] RBAC: Adding query filter params (name=network) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.489303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.492437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.493634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8365c17-d8e2-4c09-bb6f-00ce48dc6052 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.499275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.500193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.500783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.501315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.501780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 402/794] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.502498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.502994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.503276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.505403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.522214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4a640-2e85-4900-8bcf-79d407c0e57d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.526266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 393/795] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.527359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.537282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.538021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.538355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.538689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.539270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26df43-bba7-48b5-80dd-4ec7eace2ffe admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.539484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.539849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.541698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.546494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.547381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.548215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.548686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.548941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 403/796] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.549785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.549896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.550472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.552610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.577371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 394/797] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/services?type=network => generated 350 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.581632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1936b7c-7111-435e-a4ee-ab79ab0ec5ca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.585201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.597645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a6941-387e-4c33-882d-5b8dd3addea9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.600142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.601278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.601734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.602627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.612913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.613668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.613954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.614535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.615597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.616069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.616665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.618316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.650360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 10 15:42:08.651839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 404/798] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/users/swift => generated 83 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:08.659305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.666075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 395/799] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:08 2021] POST /identity/v3/endpoints => generated 327 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:42:08.675368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f61ea-8d8f-4fb7-abdb-dfb0a611a7df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.704468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.705196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.705473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.705798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.707014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.707417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.709465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.742407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 405/800] 10.222.0.60 () {56 vars in 1156 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:08.751361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.774674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fd769-d247-4d43-ac1d-78260a253304 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.783790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.784662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.784948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.785223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.799478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.801350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.823445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 396/801] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:08.841141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.860999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60d7a3-5762-474b-9847-618fc3ed6904 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.869337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.870676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.871392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.872075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.885463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.887886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:08.921385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:08.929141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 406/802] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:08.940081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:08.962149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e433-a4e8-4f50-bf20-52688bc8440c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:08.976699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:08.977439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:08.977722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:08.978016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:08.978906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:08.979212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:08.981275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:09.006482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 397/803] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:09.014216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:09.026617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094122d-c9e1-4942-9fe7-048941ca1738 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:09.033565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:09.035251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:09.035832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:09.036621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:09.046836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:09.049727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:09.069966 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:09.071917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 407/804] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:09.079547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:09.090794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045ffa-054a-49a8-904c-d6e17cc43d30 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:09.097557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:09.098915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:09.099422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:09.099916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:09.100969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:09.101469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:09.103672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afba425-1848-4fb3-a4a7-57089d5282c1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:09.119225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 398/805] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:09.127246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:09.141460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8398c-9e99-4458-91b7-4fe6c8f3ee36 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:09.147010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:09.148045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:09.148542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:09.149051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:09.150130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=025c8b235c244612932e1c931b40cf35) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:09.150657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:09.152968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380aa21-7eb5-4cc2-997e-6ffde00d8461 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:09.162826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 408/806] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:09 2021] GET /identity/v3/role_assignments?user.id=025c8b235c244612932e1c931b40cf35&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:10.740456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134853-37f6-467f-9a76-faa1722e4c97 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.741208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134853-37f6-467f-9a76-faa1722e4c97 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.741208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134853-37f6-467f-9a76-faa1722e4c97 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.743853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 399/807] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:10.751134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.751869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.751869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.770280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:10.771660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:10.786318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 409/808] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:10 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:10.804484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134853-37f6-467f-9a76-faa1722e4c97 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:10.818705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134853-37f6-467f-9a76-faa1722e4c97 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:10.823856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:10.824940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.825258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.825718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.826452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:10.828214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:10.840362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-5da59208-9417-4aaa-8322-6ea9e157f9d6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 10 15:42:10.845960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 400/809] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:10 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:10.850801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:10.860416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce6751-e7fc-4d34-8721-73bf014f3465 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:10.867109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:10.868107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.868532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.868959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.870136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:10.870652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:10.872522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a4e5-fde1-4c3a-a92f-4ea61472173f None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.872808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a4e5-fde1-4c3a-a92f-4ea61472173f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.873046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:10.873288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861a4e5-fde1-4c3a-a92f-4ea61472173f None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.875229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 401/810] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:10.881104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 410/811] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:10 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:10.881594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.881887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.882194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.890621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:10.901124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f864ef-b3f4-4408-ade4-35987a2d11a8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:10.907487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:10.908700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:10.909270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:10.910418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.910943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.911627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.912825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:10.913525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:10.915485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:10.921599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 411/813] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:10 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:10.921749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 402/813] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:10 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:10.946765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:10.957220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf4ed-7833-4adf-837b-7ce302cab4fe None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:10.962535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:10.963769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:10.964248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:10.964712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:10.977090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:10.985078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 15:42:10.987197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 403/814] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Nov 10 15:42:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:10.995466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.014108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247e3b8-8fc9-4ecf-9b83-c77093adb97f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.022370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.023653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.024106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.024769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.026394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:11.026902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.030017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.046403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 412/815] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:42:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:11.053969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.067182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a85da8-bb04-40c5-9976-ff042118f3af admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.072252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.073611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.074102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.075037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.087985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.090517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.110328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:11.112375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 404/816] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:11.119205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.133766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f71e12-98e5-4462-852a-716f27948862 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.141681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.142973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.143505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.143965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.145383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:11.145921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.149056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.174765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 413/817] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:11.181212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.193789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb08e09-cca8-4215-9445-ed6b7a0d9a00 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.198792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.199848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.201088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.201523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.211953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.214214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.241376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 15:42:11.244200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 405/818] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:11.256526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.274186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf00b-c21b-4ad0-8edb-ccb58c7c3ec9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.281855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.283040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.283523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.283987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.285605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:11.286144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.289735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.330521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 414/819] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:11.336984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.355009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765737-d8c4-4721-b4f8-3a6dae175d36 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.362701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.363800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.364299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.364794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.381223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.384581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.402599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 406/820] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:11.409557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.420701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3ba3-1c4d-44e0-a6c3-dacd4ac6ade4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.426004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.426943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.427226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.427502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.439730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.441744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.460855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:11.466344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 415/821] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:11.469411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.479313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c8952-376e-4705-a5a4-a023f71a60ef admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.484052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.484722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.485001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.485277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.486030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:11.486374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.488100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.507283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 407/822] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:11.510567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.522188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8c51-22ea-414b-bb20-67d8223b3191 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.527484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.528637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.529071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.529356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.538669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.540795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.556636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:11.564702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 416/823] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:11.566225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.576629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169ba68-c30e-4708-b908-a0dd3835b138 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.581361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.582122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.582442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.582721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.583604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:11.583911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.585921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c25a5d-e5d4-4cf9-86c5-6d12612bf528 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.606361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 408/824] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:11.609061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.622401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93742-1e12-4826-8e79-9eb5c87d7383 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.627752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.628501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.628811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.629091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.630029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] RBAC: Adding query filter params (role.id=1ca253f7b437428eacbe9ba57c5a038c, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=c57ea6e1a68f45e98ebaf2804cde1337) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:11.630391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.632412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b85e35-3c79-459a-8606-9a5f00a2580e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.642384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 417/825] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:11 2021] GET /identity/v3/role_assignments?user.id=c57ea6e1a68f45e98ebaf2804cde1337&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1ca253f7b437428eacbe9ba57c5a038c => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:11.805582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffd479-f8ec-4406-8372-e971bf6df59b None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.806309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffd479-f8ec-4406-8372-e971bf6df59b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.806474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffd479-f8ec-4406-8372-e971bf6df59b None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.809774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 409/826] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:11.819852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75c680-6d92-4f61-aac7-af6ecc996b81 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.820527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75c680-6d92-4f61-aac7-af6ecc996b81 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.820713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75c680-6d92-4f61-aac7-af6ecc996b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.849909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-eb75c680-6d92-4f61-aac7-af6ecc996b81 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:11.851729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-eb75c680-6d92-4f61-aac7-af6ecc996b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:11.869475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 418/827] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:11 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:11.903737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffd479-f8ec-4406-8372-e971bf6df59b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:11.916839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffd479-f8ec-4406-8372-e971bf6df59b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:11.921399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:11.922123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:11.922426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:11.922699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:11.923861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:11.924956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:11.924956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:42:11.924956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:42:11.925966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb49e-b70b-457f-9a15-786453947d66 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:11.944450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 410/828] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:11 2021] POST /identity/v3/services => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:42:12.396251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c75705-efd5-4dac-86b5-aca77d8cd3ce None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:12.397036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c75705-efd5-4dac-86b5-aca77d8cd3ce None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:12.397036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c75705-efd5-4dac-86b5-aca77d8cd3ce None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:12.399190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 419/829] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:12.412034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:12.412652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:12.413154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:12.434964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:12.436897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:12.456540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 411/830] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:12 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:12.480852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c75705-efd5-4dac-86b5-aca77d8cd3ce None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:12.499335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c75705-efd5-4dac-86b5-aca77d8cd3ce None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:12.504311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:12.505517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:12.506001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:12.506494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:12.507398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:12.509223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:12.521883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 15:42:12.523855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 420/831] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:12 2021] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:12.533142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:12.543840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59bf87-a416-4177-9d10-6551c2a12643 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:12.549663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:12.550627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:12.551115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:12.551590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:12.552630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:12.553144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:12.555054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b0447-587e-44e3-9c0b-249d6d02d201 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:12.560922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 412/832] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:12 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:12.567771 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:12.578821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d882-b1c8-4fff-a671-3223c89519a7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:12.583856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:12.584759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:12.585241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:12.585712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:12.586739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:12.587254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:12.589171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8ce23-5087-4106-be48-321f214033f5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:12.595481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 421/833] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:12 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:13.732596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3af898-78a1-4a63-8197-6aba441111b5 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:13.733105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3af898-78a1-4a63-8197-6aba441111b5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:13.733105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3af898-78a1-4a63-8197-6aba441111b5 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:13.735648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 413/834] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:13.742429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a119cb-7fb9-475c-bc88-816dd2087fc5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:13.743391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a119cb-7fb9-475c-bc88-816dd2087fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:13.743852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a119cb-7fb9-475c-bc88-816dd2087fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:13.774284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-00a119cb-7fb9-475c-bc88-816dd2087fc5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:13.776153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00a119cb-7fb9-475c-bc88-816dd2087fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:13.785363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 422/835] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:13 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:13.813415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3af898-78a1-4a63-8197-6aba441111b5 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:13.829238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3af898-78a1-4a63-8197-6aba441111b5 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:13.834942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7335d0-018a-4b5d-9b02-6b3993807905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:13.836636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7335d0-018a-4b5d-9b02-6b3993807905 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:13.837437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7335d0-018a-4b5d-9b02-6b3993807905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:13.838313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7335d0-018a-4b5d-9b02-6b3993807905 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:13.840172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7335d0-018a-4b5d-9b02-6b3993807905 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:13.843602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7335d0-018a-4b5d-9b02-6b3993807905 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:13.863371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 414/836] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:13 2021] POST /identity/v3/services => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:14.623178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de30350-7215-4b53-a9ac-4abb8913724b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.623947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de30350-7215-4b53-a9ac-4abb8913724b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.624432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de30350-7215-4b53-a9ac-4abb8913724b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.626937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 423/837] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:14.632974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.633550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.634040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.656415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:14.658733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:14.665273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966fbb-3076-4318-ae3b-818f3bbaa536 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.666041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966fbb-3076-4318-ae3b-818f3bbaa536 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.666714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966fbb-3076-4318-ae3b-818f3bbaa536 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.674346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 424/838] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:14.679226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.679794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.680257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.681775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 415/839] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:14 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:14.708777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:14.710656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:14.717144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.726354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 425/840] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:14 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:14.733349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d37c2-eaaa-400a-ab99-5deaa67f7cfa None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.742346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.744295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.745172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.745919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.747875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.752211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.752965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.766805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70a1c7-8419-4a64-9967-3cbb221c44c0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.771668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.772531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.772813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.773089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.776701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 10 15:42:14.780151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 416/841] 10.222.0.60 () {56 vars in 1153 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:14.788416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.792788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:14.799575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c239-b315-45ba-be17-66819e0119c5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.802971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 15:42:14.805001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 426/842] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:14.813201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.813201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.813201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.813201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.813586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:14.813586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.814944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.816178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.828263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d4ecb-3151-4437-82db-3200d8183695 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.829364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 417/843] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:14.831895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.836102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.837389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.838039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.838872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.840049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:14.841538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.844044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.844831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94487c0-107c-4fcb-9c85-fe9261191e4a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.849901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.850666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.850949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.851229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.852093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:14.852405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.854065 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.870291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 418/845] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:14.870291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.870800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 427/845] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:14.874042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.880325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1022d-6261-4108-9de6-25198683bd37 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.885019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.885760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.886037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.886395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.886663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99e930-700a-4fad-9064-3b455e927583 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.887480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] RBAC: Adding query filter params (interface=public, service_id=8bb03a5a6d784756a5cc9a9b2de48189, region_id=RegionOne) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:14.887794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.889027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:14.889027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:42:14.889027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:42:14.890146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.893110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.894145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.894646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.895129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.905401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 419/846] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/endpoints?service_id=8bb03a5a6d784756a5cc9a9b2de48189&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:14.906823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.909780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.912023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.920207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e236-b8de-4a3a-8971-3e1f73799845 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.925408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.926035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.926343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.926614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.927314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.929091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.935560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:14.937307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 428/848] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:14.944200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 420/848] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:42:14.945625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:14.957715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19d534-32c5-4160-babb-5c80b5335a1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:14.963380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:14.964634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:14.965254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:14.965811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:14.966908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:14.967440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:14.969448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:14.985358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 429/849] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:14.992534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.003524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861073-d86f-4a7f-bb75-892832c6cddb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.010405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.011691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.012322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.012814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.024157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.028908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.048771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 15:42:15.050874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 421/850] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:42:14 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:15.058008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.069588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2bef8-9ab3-4c09-be70-4b97471115c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.075443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.076793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.077293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.077839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.079004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:15.079524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.081716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31f8d5-c143-4e2c-8994-58df97b74f69 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.104791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 430/851] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Nov 10 15:42:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:15.112193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.124331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09e23b-c1b5-4656-ae2b-812d062d29c4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.127920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f4ed-1b41-4f8a-81f2-778cf84205da None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.128548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f4ed-1b41-4f8a-81f2-778cf84205da None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.129143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f4ed-1b41-4f8a-81f2-778cf84205da None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.131870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 431/852] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:15.140660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.141354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.141479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.142032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.142568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.143070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.143561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.165209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.168996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.169276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:15.171423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:15.189626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 432/853] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:15 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:15.199016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:15.201491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 422/854] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:15.210579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.230250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.230484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59476-3b32-4a3a-8bfb-a3f2216ca73e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.236281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.237604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.237888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.238185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.239023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:15.239323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.240965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.247440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76771a9-27df-4454-90f7-94cd5fff82da admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.263207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 433/855] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:15.265582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.265582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.265926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.268265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.268265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.269658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.271559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.288301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b84a0d-c9a2-444e-9cf3-cf5c613b198d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.292771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 423/856] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:15 2021] POST /identity/v3/services => generated 241 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:42:15.311169 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.312341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.312779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.313273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.323583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.326419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.344957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:15.347019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 434/857] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:15.355652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.368945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe2773-8b60-41d2-abba-8fc663307ca6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.374634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.375623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.376049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.376482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.377515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:15.377973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.380320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5be2-2a79-4153-93f5-f8491370b2fa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.401368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 424/858] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:15.403210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:15.415091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0320-c63a-40a7-ba1b-a00edbc9eadf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:15.420386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384db8-afe2-4e29-8204-0012db84964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:15.421750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384db8-afe2-4e29-8204-0012db84964f admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:15.422246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384db8-afe2-4e29-8204-0012db84964f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:15.423207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384db8-afe2-4e29-8204-0012db84964f admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/c57ea6e1a68f45e98ebaf2804cde1337/roles/1ca253f7b437428eacbe9ba57c5a038c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:15.425958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b384db8-afe2-4e29-8204-0012db84964f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=c57ea6e1a68f45e98ebaf2804cde1337, role_id=1ca253f7b437428eacbe9ba57c5a038c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:15.429060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b384db8-afe2-4e29-8204-0012db84964f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:15.450433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 435/859] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:15 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/c57ea6e1a68f45e98ebaf2804cde1337/roles/1ca253f7b437428eacbe9ba57c5a038c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:42:16.493508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765971fa-e362-4803-8999-3715835fdcaf None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.494440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765971fa-e362-4803-8999-3715835fdcaf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.494440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765971fa-e362-4803-8999-3715835fdcaf None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.496407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 425/860] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:16.503433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.504151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.504151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.528517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:16.530133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:16.602027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 436/861] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:16 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:16.633241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765971fa-e362-4803-8999-3715835fdcaf None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:16.646948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765971fa-e362-4803-8999-3715835fdcaf None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:16.652198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:16.653239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.654381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.654381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.655537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:16.657239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:16.674796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 10 15:42:16.676739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 426/862] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:16 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:16.686036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:16.695478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100055b-a2bc-4bac-80e7-42932a0a8be4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:16.701222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:16.701903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.702203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.702483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.703217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:16.703519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:16.705149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:16.711981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 437/863] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:16 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:16.720484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:16.736163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf5b0-73bc-4955-bf75-140eb81b39d8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:16.743212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:16.744468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.744988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.745588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.747121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:16.747850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:16.750760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:16.759669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 427/864] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:16 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:16.770136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:16.783922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2f913-e8bd-4911-9e4d-4a1bdc029d21 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:16.789026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:16.789716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.790187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.790657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.791802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] RBAC: Adding query filter params (interface=public, service_id=80f8d931a2b64dc792b62257569e8a42, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:16.792205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:16.794053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6959b-7a1e-45c8-aabd-e9dbb5537ff3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:16.804732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 438/865] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:16 2021] GET /identity/v3/endpoints?service_id=80f8d931a2b64dc792b62257569e8a42&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:16.813541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:16.829363 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bf547-9293-4b49-af17-dc7503a9950f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:16.835880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d843a-5f37-480d-b7b4-13c0ee2b5490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:16.837021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d843a-5f37-480d-b7b4-13c0ee2b5490 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:16.837481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d843a-5f37-480d-b7b4-13c0ee2b5490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:16.840429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d843a-5f37-480d-b7b4-13c0ee2b5490 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:16.841611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d843a-5f37-480d-b7b4-13c0ee2b5490 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:16.843762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d843a-5f37-480d-b7b4-13c0ee2b5490 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:16.855190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 428/866] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:16 2021] GET /identity/v3/services => generated 1497 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:42:17.891300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2119051-8114-48d4-9e31-6709351d10bc None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:17.892191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2119051-8114-48d4-9e31-6709351d10bc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:17.892191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2119051-8114-48d4-9e31-6709351d10bc None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:17.896629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 439/867] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:17.908116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe93b04-a205-49a0-8962-3023ec99f81a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:17.909063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe93b04-a205-49a0-8962-3023ec99f81a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:17.909063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe93b04-a205-49a0-8962-3023ec99f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:17.942516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8fe93b04-a205-49a0-8962-3023ec99f81a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:17.945220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8fe93b04-a205-49a0-8962-3023ec99f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:17.961169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 429/868] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:17 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:18.002048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2119051-8114-48d4-9e31-6709351d10bc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.024070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2119051-8114-48d4-9e31-6709351d10bc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.032100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.033514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.034007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.034530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.035810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.038726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.060805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e817-a4a1-4049-bb43-a261a57326ec None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.061240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e817-a4a1-4049-bb43-a261a57326ec None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.061367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-9ff36df6-0e50-4850-b8bd-d7baaa8d5fd1 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 10 15:42:18.061680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e817-a4a1-4049-bb43-a261a57326ec None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.063770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 440/869] 10.222.0.60 () {56 vars in 1153 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:18.065022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 430/870] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:18.075425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f355dc7-ba9c-4ab6-b347-b2c7bfc9acd8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.075919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f355dc7-ba9c-4ab6-b347-b2c7bfc9acd8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.076364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f355dc7-ba9c-4ab6-b347-b2c7bfc9acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.077381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e817-a4a1-4049-bb43-a261a57326ec None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.094222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e817-a4a1-4049-bb43-a261a57326ec None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.098887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.099583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.099864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.100243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.101013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.101163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1f355dc7-ba9c-4ab6-b347-b2c7bfc9acd8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:18.101307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.102365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1f355dc7-ba9c-4ab6-b347-b2c7bfc9acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:18.103100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.114421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 431/871] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:18.116570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.117997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 441/872] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:18 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:18.120936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947fb48-f3a6-40dd-ab38-4e80b23caece None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.121354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947fb48-f3a6-40dd-ab38-4e80b23caece None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.121728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947fb48-f3a6-40dd-ab38-4e80b23caece None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.125186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 442/873] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:18.128659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd8a82-44e8-44ae-b97b-aa9a3a890c24 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.130776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.131064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.131504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.133646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.134500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.134789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.135156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.135897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.136202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.138041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.144163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 432/874] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:18.151272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.151580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:18.152910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:18.162089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 443/875] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:18 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:18.163008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a580a-0747-4b92-beb6-150a12d9ab63 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.164226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.167911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.168772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.169054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.169322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.170004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.171684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.179082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ced5f-976a-4494-8e41-1b7ab55e2604 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.185032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 15:42:18.185802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.193148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 433/876] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:42:18.193348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:42:18.193781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.195331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.206487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01593a60-bdb5-4118-910a-650d31ebfca0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.220761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.222100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.222487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.222739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.225083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 444/877] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:18 2021] POST /identity/v3/endpoints => generated 347 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:18.225865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.254788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:18.265892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 15:42:18.274393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f660a7-a12f-4cc6-87ec-ae16534648ed admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.274614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 434/878] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:18.280041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.281558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.282464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.282887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.283360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.284410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.284898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.286834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.293255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58b41f-3273-4433-ac6d-39384db63102 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.295113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 445/879] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:18.299848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.301186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.301819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.302384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.303491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.303889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.304192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.306644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.318090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c7792-864c-48d0-a3aa-1cb95532c106 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.320781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 435/880] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:18.327987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.331175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.331861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.332139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.332426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.333263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.333571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.335361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.343222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4e978-ac3a-4358-a9fe-4f5bdac8e071 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.344382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 446/881] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:18.348656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.349529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.349816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.350094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.354743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.367935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b352b0-ca75-454a-b937-f8033008b991 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.370464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.374531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.374987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.375864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.376387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.376886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.378737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] RBAC: Adding query filter params (interface=public, service_id=b106ea5d7968476981a129cca1fabfe0, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.379357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.381686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.398419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:18.399277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 447/883] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/endpoints?service_id=b106ea5d7968476981a129cca1fabfe0&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:18.402888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 436/883] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:18.405027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.408045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.424461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91260dfd-8048-4e09-aed4-2285d59f6ad1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.426353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.427052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.427334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.427625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.428369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.430063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d826-21d2-4256-98ab-202287ad6665 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.430260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.446207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 437/884] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:42:18.446431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.446431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.446431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.446899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.448389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.448837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.451366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.474313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 448/885] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:18.479964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.494781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a0b3-6839-4a1e-979a-3b0e31f13b00 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.501228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.502322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.502608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.502941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.513770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.516024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.533587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 10 15:42:18.536389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 438/886] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:18.542676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.555745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e597-79b2-43d9-9310-38c118aed609 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.562098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.562987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.563294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.563571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.564559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.564863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.567021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.595418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 449/887] 10.222.0.60 () {56 vars in 1170 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:18.603278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.616957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef385cd9-3c93-46a4-9574-a9bbbf6428d6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.622654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.623594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.623886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.624166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.634623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.636550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.654469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 439/888] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:18.657717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.669015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339039-9cf3-4910-b042-0b9cb504e22a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.675245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.676238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.676522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.676800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.694194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.697398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.722457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:18.724027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 450/889] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:18.733353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.745856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c0f4-8b1f-45db-805b-de55303cf3e5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.751627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.752333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.752617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.752895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.753819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.754040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.755763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.771895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 440/890] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:18.779229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.794449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc598f-fab6-4a34-b60e-61a0bdd033d0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.801679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.802564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.802850 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.803122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.812204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.814270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.829622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:18.837618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 451/891] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:18.839552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.852910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12074e3d-4c1a-47d1-8cb3-a4a70ca6e27b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.858716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.859472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.859757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.860091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.860959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.861315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.863339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624afd4-aff0-40a2-bfbc-86c66fb29a46 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.882328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 441/892] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:18.885346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:18.896853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bed791-cfa6-4075-8191-a3879546e58d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:18.902585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:18.903336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:18.903782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:18.904174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:18.905186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] RBAC: Adding query filter params (role.id=1ca253f7b437428eacbe9ba57c5a038c, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=c57ea6e1a68f45e98ebaf2804cde1337) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:18.905451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:18.907461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214852e2-8619-4b8b-9a5d-219074288351 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:18.922310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 452/893] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:18 2021] GET /identity/v3/role_assignments?user.id=c57ea6e1a68f45e98ebaf2804cde1337&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1ca253f7b437428eacbe9ba57c5a038c => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:19.983900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fea15-2683-480c-94d7-a252bf42951a None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:19.984529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fea15-2683-480c-94d7-a252bf42951a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:19.984529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fea15-2683-480c-94d7-a252bf42951a None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:19.987629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 442/894] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:19.995695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:19.996299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:19.996299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.015580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:20.016792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:20.025915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 453/895] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:19 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:20.051272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fea15-2683-480c-94d7-a252bf42951a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:20.071831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fea15-2683-480c-94d7-a252bf42951a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:20.079241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:20.080485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:20.080921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:20.081357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.082459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:20.085353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:20.105513 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 10 15:42:20.108209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 443/896] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:20 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:20.116177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:20.125912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7d807-891a-4bba-bf71-6bdcb2f07238 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:20.131558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:20.132242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:20.132529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:20.132803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.133576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:20.133883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:20.135542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:20.141463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 454/897] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:20.148221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:20.162614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadfebe-1c0f-40a8-8efe-448d47961ffd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:20.169765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:20.170859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:20.171303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:20.171727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.173327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:20.173850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:20.176759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909d98b-bf5e-42ef-9220-af9bf3dbec59 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:20.185479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 444/898] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Nov 10 15:42:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:20.191981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:20.202237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eee089-db74-4f31-a61b-a6909da78f08 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:20.206942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf6f1-8c0e-42b5-82d7-a5bf42c68b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:20.207596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf6f1-8c0e-42b5-82d7-a5bf42c68b3c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:20.207874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf6f1-8c0e-42b5-82d7-a5bf42c68b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:20.208147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf6f1-8c0e-42b5-82d7-a5bf42c68b3c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.208912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf6f1-8c0e-42b5-82d7-a5bf42c68b3c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:20.214018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf6f1-8c0e-42b5-82d7-a5bf42c68b3c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:20.240709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 455/899] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:20 2021] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:20.956675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014a6a-f0ca-42ef-bda4-89f133624a78 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:20.957094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014a6a-f0ca-42ef-bda4-89f133624a78 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:20.957290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014a6a-f0ca-42ef-bda4-89f133624a78 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.959294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 445/900] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:20.966186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:20.966489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:20.966738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:20.986829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:20.988055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:21.012062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 456/901] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:20 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:21.032229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78158d-5eeb-4e2b-bb25-e3b88f6d3206 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.032866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78158d-5eeb-4e2b-bb25-e3b88f6d3206 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.032866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78158d-5eeb-4e2b-bb25-e3b88f6d3206 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.035119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 446/902] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:21.036632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.042194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.042491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.042735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.048820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd32e3-7877-4a7a-a968-6d7532eeead5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.054661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.055496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.055785 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.056051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.056758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.058584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.065383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:21.066654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:21.075541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 447/903] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:21 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:21.079380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 10 15:42:21.080903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 457/904] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:21 2021] GET /identity/v3/services/compute => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:21.089404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.099923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96707e-c86e-4362-966b-b5a4d041b36e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.104743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.105587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.106336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.106785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.107567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:21.107942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.109735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.115905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 448/905] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:21 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:21.122909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.123235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.134420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf827-a22e-4ae0-a9e7-dbdf808cf393 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.134823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadc2b8-f31e-4a37-b65e-b6653343a57d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.140183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.141007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.141280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.141550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.142386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.143208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.144138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.144482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.145211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.145737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.147168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:21.147737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.149687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.156148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 449/906] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:21 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:21.160210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 15:42:21.169702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 458/907] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:21 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:21.176139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.194694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fdae3-49ef-4878-9103-97f7fd79a8e0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.201379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.202525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.202974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.203386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.204693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:21.205204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.208386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.221946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 450/908] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:21 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:21.228972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.242390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a09f0-597c-4d52-a28b-6a3cd2a42fe2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.254364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.255524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.255987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.256424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.257766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:21.258293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.261452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78146dea-b499-4692-abde-d619f90779c9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.278414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 459/909] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:21 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:21.284050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:21.302483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b361156-6447-4286-8ca2-a313128af45b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:21.310612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58f0e4-2976-4a6a-b819-78e57741b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:21.311837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58f0e4-2976-4a6a-b819-78e57741b41d admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.312290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58f0e4-2976-4a6a-b819-78e57741b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.312827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58f0e4-2976-4a6a-b819-78e57741b41d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.314240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58f0e4-2976-4a6a-b819-78e57741b41d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:21.317468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58f0e4-2976-4a6a-b819-78e57741b41d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:21.354418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 451/910] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:21 2021] POST /identity/v3/endpoints => generated 349 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:21.988152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fafa9-440f-47ee-a64c-d9042d70b8a0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.988444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fafa9-440f-47ee-a64c-d9042d70b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.988797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fafa9-440f-47ee-a64c-d9042d70b8a0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:21.991066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 460/911] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:21.998983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:21.999387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:21.999663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:22.020604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:22.021832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:22.047058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 452/912] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:21 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:22.074448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fafa9-440f-47ee-a64c-d9042d70b8a0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:22.093414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fafa9-440f-47ee-a64c-d9042d70b8a0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:22.098001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:22.098857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:22.099137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:22.099411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:22.100133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:22.101766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:22.113892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 10 15:42:22.116236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 461/913] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Nov 10 15:42:22 2021] GET /identity/v3/services/image => generated 86 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:22.125356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:22.137872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa007f8-af78-4d0d-a8a5-1db78c4da881 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:22.143057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:22.143745 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:22.144022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:22.144294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:22.145173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:22.145643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:22.147385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c235c-bf0b-4f78-aef0-37d2262a45a2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:22.153694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 453/914] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:22 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:22.164378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:22.181283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49688f-8032-4558-946f-ce2841629668 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:22.187016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:22.187701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:22.187981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:22.188235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:22.188987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] RBAC: Adding query filter params (type=image) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:22.189289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:22.190947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1752c-df9c-45af-b692-797a3ff982fe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:22.196418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 462/915] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:22 2021] GET /identity/v3/services?type=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:23.057675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd658-79cc-4c5a-92a9-525064a8e406 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.058909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd658-79cc-4c5a-92a9-525064a8e406 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.058909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd658-79cc-4c5a-92a9-525064a8e406 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.060930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 454/916] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:23.068095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.068740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.069447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.094458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:23.097624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:23.111369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 463/917] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:23 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:23.145972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffd658-79cc-4c5a-92a9-525064a8e406 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:23.163568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffd658-79cc-4c5a-92a9-525064a8e406 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:23.170395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:23.171887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.172839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.173457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.174590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:23.177755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:23.180755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.common [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 10 15:42:23.215988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.sql.core [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 10 15:42:23.215988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 10 15:42:23.215988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [parameters: {'id': 'fd01ea16581a4ea499a4163866b1a864', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 10 15:42:23.215988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 15:42:23.227178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd01ea16581a4ea499a4163866b1a864.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd01ea16581a4ea499a4163866b1a864. Nov 10 15:42:23.234668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 455/918] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Nov 10 15:42:23 2021] POST /identity/v3/projects => generated 262 bytes in 89 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:23.242341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:23.257811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27700fde-ac83-4fa7-8d50-c6d4efeeacb6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:23.264918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:23.266271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.266725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.267189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.278961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:23.282122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:23.305412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-2075df35-7aad-476b-bb4b-ea1bc2697e22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:23.307861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 464/919] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:23.319151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:23.337751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eb020-da08-4eef-8ed5-62533dfe84a0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:23.345351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:23.346531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.346960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.347404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.348808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:23.349342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:23.353384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bc390-97ee-4e08-8e06-a326ac2724ac admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:23.389747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 456/920] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:23 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:23.918015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1ad7-63c2-4047-a6df-efc7749b223b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.918515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1ad7-63c2-4047-a6df-efc7749b223b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.918940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1ad7-63c2-4047-a6df-efc7749b223b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.921177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 465/921] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:23.928523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d1e69-7bc3-4c07-9872-feef50dc0eec None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:23.929136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d1e69-7bc3-4c07-9872-feef50dc0eec None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:23.929639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d1e69-7bc3-4c07-9872-feef50dc0eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:23.956681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-431d1e69-7bc3-4c07-9872-feef50dc0eec None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:23.959320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-431d1e69-7bc3-4c07-9872-feef50dc0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:23.969377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 457/922] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:23 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:24.000830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1ad7-63c2-4047-a6df-efc7749b223b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.019077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1ad7-63c2-4047-a6df-efc7749b223b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.025030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5a903-b020-4912-a379-718dba4e513e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.025704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a903-b020-4912-a379-718dba4e513e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.026021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a903-b020-4912-a379-718dba4e513e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.026333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a903-b020-4912-a379-718dba4e513e admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.027387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5a903-b020-4912-a379-718dba4e513e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.029698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5a903-b020-4912-a379-718dba4e513e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.064211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 466/923] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:23 2021] POST /identity/v3/services => generated 242 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:24.210314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459d651-6a8c-45cc-a4ed-062b0f6d1254 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.210825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459d651-6a8c-45cc-a4ed-062b0f6d1254 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.210825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459d651-6a8c-45cc-a4ed-062b0f6d1254 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.214324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 458/924] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:24.224202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.225324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.225853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.255179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:24.257817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:24.297426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 467/925] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:24 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:24.337216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459d651-6a8c-45cc-a4ed-062b0f6d1254 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.351844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459d651-6a8c-45cc-a4ed-062b0f6d1254 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.358475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.359770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.360302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.360767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.361678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.363720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.379617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 15:42:24.381572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 459/926] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:24.393459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.406021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945def42-2e33-4a9f-9264-174fb345ff7f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.411158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.411858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.412140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.412415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.413179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:24.413484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.415195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.421727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 468/927] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:24.429033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.441296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86133eab-dce3-4d13-8059-3fa0055d8499 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.446936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.448125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.448545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.449151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.450281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:24.450797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.452692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.462402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 460/928] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:24.467471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.478265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4d196-a6d7-415b-bbf7-3f233906d52d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.483886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.484856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.485280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.485746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.487012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] RBAC: Adding query filter params (interface=admin, service_id=b106ea5d7968476981a129cca1fabfe0, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:24.487486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.489770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193b9c6-01cb-4ab5-85a3-15026f30f212 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.506355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 469/929] 10.222.0.60 () {56 vars in 1270 bytes} [Wed Nov 10 15:42:24 2021] GET /identity/v3/endpoints?service_id=b106ea5d7968476981a129cca1fabfe0&interface=admin®ion_id=RegionOne => generated 193 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:24.511819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.530019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d0fc8-5e9b-4a76-911f-6fb5735ecc01 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.538328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cad2a4-c81c-4d79-aa2b-a856073f99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.539767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cad2a4-c81c-4d79-aa2b-a856073f99aa admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.540631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cad2a4-c81c-4d79-aa2b-a856073f99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.541323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cad2a4-c81c-4d79-aa2b-a856073f99aa admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.543030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cad2a4-c81c-4d79-aa2b-a856073f99aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.546482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cad2a4-c81c-4d79-aa2b-a856073f99aa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.566370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 461/930] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:24 2021] GET /identity/v3/services => generated 1727 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:42:24.786685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5b6f-9b9b-4103-a4b1-ebeb65ccc84a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.787669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5b6f-9b9b-4103-a4b1-ebeb65ccc84a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.788424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5b6f-9b9b-4103-a4b1-ebeb65ccc84a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.792378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 470/931] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:24 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:24.799137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc361f-8550-4ce4-a486-043ddb44f13f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.799429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc361f-8550-4ce4-a486-043ddb44f13f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.799742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc361f-8550-4ce4-a486-043ddb44f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.823826 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-72bc361f-8550-4ce4-a486-043ddb44f13f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:24.825491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-72bc361f-8550-4ce4-a486-043ddb44f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:24.834400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 462/932] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:24 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:24.858836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af5b6f-9b9b-4103-a4b1-ebeb65ccc84a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:24.876741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af5b6f-9b9b-4103-a4b1-ebeb65ccc84a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:24.882663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b15b87-3c25-4add-8844-1106cf318894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:24.883337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15b87-3c25-4add-8844-1106cf318894 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:24.883606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15b87-3c25-4add-8844-1106cf318894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:24.883887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b15b87-3c25-4add-8844-1106cf318894 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:24.884657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b15b87-3c25-4add-8844-1106cf318894 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:24.886296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b15b87-3c25-4add-8844-1106cf318894 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:24.944547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 471/933] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:24 2021] POST /identity/v3/services => generated 242 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:26.125959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f3ab5-2448-4e05-9011-72ba2078efdf None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.126514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f3ab5-2448-4e05-9011-72ba2078efdf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.126514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f3ab5-2448-4e05-9011-72ba2078efdf None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:26.129522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 463/934] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:26.138420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.139026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.139026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:26.160220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:26.161719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:26.182871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 472/935] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:26 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:26.213409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f3ab5-2448-4e05-9011-72ba2078efdf None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:26.231764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f3ab5-2448-4e05-9011-72ba2078efdf None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:26.237865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:26.238585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.238860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.239141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:26.239885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:26.242202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:26.261520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.sql.core [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 10 15:42:26.261520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 10 15:42:26.261520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [parameters: {'user_id': '71e538f72ce54b2caeeb730eef6dd379', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 10 15:42:26.261520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 10 15:42:26.268352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 10 15:42:26.270238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 464/936] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:42:26 2021] POST /identity/v3/users => generated 160 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:26.279656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:26.293423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010016b-ca52-40ea-a7fd-31d6200c666b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:26.299731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:26.301081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.301557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.301949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:26.315424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:26.318627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:26.333606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-55f5043c-7126-4123-ab57-611a18ff6a93 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 10 15:42:26.335241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 473/937] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:26.342294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:26.353122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5303a34-6506-428a-9e26-bc97ad493147 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:26.358108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:26.358836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.359115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.359386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:26.360222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:26.360521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:26.362700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78323012-4e07-402a-9548-e299c32c1a6f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:26.406663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 465/938] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Nov 10 15:42:26 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:26.981569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9067206-9aa6-483e-8f78-449b542feb6a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.981883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9067206-9aa6-483e-8f78-449b542feb6a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.982126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9067206-9aa6-483e-8f78-449b542feb6a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:26.984057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 474/939] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:26.990771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:26.991145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:26.991495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.012580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:27.014272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:27.022731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 466/940] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:26 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:27.050031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9067206-9aa6-483e-8f78-449b542feb6a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.071820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9067206-9aa6-483e-8f78-449b542feb6a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.077432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.078278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.078560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.078834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.079518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.081160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.094043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 10 15:42:27.095506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 475/941] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:27.102508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.112499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659f77-8075-4b69-aff9-38d4b1e265f6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.118004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.118726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.119009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.119287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.120032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.120334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.122080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.128009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 467/942] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.134954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.145436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637ec5d-153d-449f-bbd1-fdfb9ddb9382 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.151454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.152397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.152789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.153049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.153729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.154225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.155984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16fc8d-6c48-4fc7-8075-be3fa9cfebea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.162279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 476/943] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.168794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.179126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666fb8-8a5a-4247-9fe0-2b7a3ca2cc0d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.184730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.185437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.185700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.185988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.186996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] RBAC: Adding query filter params (interface=public, service_id=b70e87ed85324590b834f756df502fa9, region_id=RegionOne) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.187495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.189321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.195598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede51f9-104c-4e59-9357-769dcbed17da None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.195873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede51f9-104c-4e59-9357-769dcbed17da None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.196159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede51f9-104c-4e59-9357-769dcbed17da None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.196488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 468/944] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/endpoints?service_id=b70e87ed85324590b834f756df502fa9&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.198113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 477/945] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:27.202867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.204140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.204427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.204705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.224290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:27.225497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:27.227437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a34321-8c0a-4e53-8d88-bf82a055fe3d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.235732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.236495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.236932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.237374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.238308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 478/946] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:27.238444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.241388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.259588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 469/947] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services => generated 1957 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:42:27.259796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.269931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9dc9-7cfe-496d-99dc-78a54cf126ef None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.275221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.276153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.276447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.276724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.277484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.279469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.293232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 10 15:42:27.294973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 479/948] 10.222.0.60 () {56 vars in 1147 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:27.302106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.313121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f4b1-c87b-4f39-b3ed-94bf12d68c29 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.318378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.319126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.319386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.319664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.320433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.320774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.322557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.329978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 470/949] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.336593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.347514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadb2dc-2047-4e0d-b5ff-48f373230df4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.352765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.353490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.353768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.354056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.354915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.355341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.357315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56119dec-4291-450f-997e-359e69ecc5bc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.363852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 480/950] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.370707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.390255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e192e2-31ec-49ba-a077-f480e0ac0fe4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.397511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbaa4b-5f19-44f1-b0e5-b1713d53bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.398252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbaa4b-5f19-44f1-b0e5-b1713d53bf07 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.398532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbaa4b-5f19-44f1-b0e5-b1713d53bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.398801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbaa4b-5f19-44f1-b0e5-b1713d53bf07 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.399586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbaa4b-5f19-44f1-b0e5-b1713d53bf07 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.401489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbaa4b-5f19-44f1-b0e5-b1713d53bf07 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.423769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 471/951] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:27 2021] POST /identity/v3/endpoints => generated 325 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:27.586422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec8bb-5a85-4332-b346-ce8d566279e0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.586827 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec8bb-5a85-4332-b346-ce8d566279e0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.587047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec8bb-5a85-4332-b346-ce8d566279e0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.589158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 481/952] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:27.598796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09305d0a-064b-447a-82c2-19586a183070 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.599013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09305d0a-064b-447a-82c2-19586a183070 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.599239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09305d0a-064b-447a-82c2-19586a183070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.619721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-09305d0a-064b-447a-82c2-19586a183070 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:27.621130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-09305d0a-064b-447a-82c2-19586a183070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:27.641381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 472/953] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:27 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:27.666676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec8bb-5a85-4332-b346-ce8d566279e0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.680708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec8bb-5a85-4332-b346-ce8d566279e0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.686510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.687421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.687727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.688001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.688681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.690302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.703384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 10 15:42:27.705065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 482/954] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:27.711571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09305d0a-064b-447a-82c2-19586a183070 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.722957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09305d0a-064b-447a-82c2-19586a183070 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.728899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.729582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.729869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.730201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.730935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.731242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.732877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.738705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 473/955] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.745908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.757817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a25aa8-794e-47c0-bfd7-731fc06c5530 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.766362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.767064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.767328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.767593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.768318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.768615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.770327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.776203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 483/956] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services?type=image => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.783029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.793814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3439-ca77-41f1-a14e-9702cc7ac163 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.799428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.800109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.800400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.800659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.801486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] RBAC: Adding query filter params (interface=public, service_id=d60a61bf83aa4dd1b3a7cc42cbeca45b, region_id=RegionOne) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:27.801778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.803428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a2ad-a182-4f8d-a5ee-17e551242cd3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.811298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 474/957] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/endpoints?service_id=d60a61bf83aa4dd1b3a7cc42cbeca45b&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:27.820484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:27.832343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b8e3e-f3f1-4bb9-b510-fbb4225dd467 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:27.839342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7495fa3-97d7-408f-b9db-8ce26b404fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:27.840073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495fa3-97d7-408f-b9db-8ce26b404fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:27.840419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495fa3-97d7-408f-b9db-8ce26b404fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:27.840737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495fa3-97d7-408f-b9db-8ce26b404fd9 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:27.841573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7495fa3-97d7-408f-b9db-8ce26b404fd9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:27.843215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7495fa3-97d7-408f-b9db-8ce26b404fd9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:27.851514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 484/958] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:42:27 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:42:29.624027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77865-d2f8-428f-84d6-4e19eb4c31d9 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.624563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77865-d2f8-428f-84d6-4e19eb4c31d9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.624563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77865-d2f8-428f-84d6-4e19eb4c31d9 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.626490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 475/959] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:29.632630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.633046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.633140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.653078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:29.654365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:29.662968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 485/960] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:29 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:29.689752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e77865-d2f8-428f-84d6-4e19eb4c31d9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:29.703209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e77865-d2f8-428f-84d6-4e19eb4c31d9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:29.707776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:29.708565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.708841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.709112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.709787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:29.711431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:29.722741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 10 15:42:29.724145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 476/961] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:29.731269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:29.741096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019ffd2-afd8-41f8-b7a3-1290aa948d47 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:29.746588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:29.746883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.747119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.747403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.748344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:29.748646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:29.750330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:29.755946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 486/962] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:29.762522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:29.772700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1e65-7304-4793-978b-333aa73b56fa admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:29.777858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:29.778355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.778530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.778819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.779551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:29.779862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:29.781481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feded0-e08e-4ac9-b2a5-b14b8abfcd48 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:29.787303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 477/963] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Nov 10 15:42:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:29.793927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:29.804838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf918a-3062-4d15-ab7f-5debd59ebaf3 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.805188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf918a-3062-4d15-ab7f-5debd59ebaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.805375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf918a-3062-4d15-ab7f-5debd59ebaf3 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.807277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 478/964] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:29.812341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c491b5-16aa-479a-be8a-1f7411cd045c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:29.814362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.814707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.814930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.817697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:29.818287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.818571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.818839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.819602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:29.821185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:29.833996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:29.835271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:29.843611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 487/965] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:29 2021] POST /identity/v3/endpoints => generated 334 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:42:29.846316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 479/966] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:29 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:29.870415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:29.896105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4fb4a-bef5-4262-b2ac-db60d0d23eba admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:29.901724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6811b36-f87d-48d1-b73d-79c5292e0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:29.903480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6811b36-f87d-48d1-b73d-79c5292e0c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.903753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6811b36-f87d-48d1-b73d-79c5292e0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.904029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6811b36-f87d-48d1-b73d-79c5292e0c82 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.905438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6811b36-f87d-48d1-b73d-79c5292e0c82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:29.907259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6811b36-f87d-48d1-b73d-79c5292e0c82 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:29.914193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 488/967] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:29.917129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:29.928926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f8e89-d023-48db-b12b-60d227bf41df None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:29.936573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e93341-8275-4863-a854-fcf4359b83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:29.937318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93341-8275-4863-a854-fcf4359b83e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:29.937607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93341-8275-4863-a854-fcf4359b83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:29.937878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93341-8275-4863-a854-fcf4359b83e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:29.938835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93341-8275-4863-a854-fcf4359b83e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:29.941140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93341-8275-4863-a854-fcf4359b83e9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:29.978897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 480/968] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:29 2021] POST /identity/v3/projects => generated 311 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:30.206657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5bbb9-1927-41ce-aae6-2a0051c1252b None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:30.206888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5bbb9-1927-41ce-aae6-2a0051c1252b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:30.207226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5bbb9-1927-41ce-aae6-2a0051c1252b None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:30.209175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 489/969] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:30.216088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:30.216370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:30.216649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:30.238231 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:30.239529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:30.341469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 481/970] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:30 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:30.369168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5bbb9-1927-41ce-aae6-2a0051c1252b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:30.383778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5bbb9-1927-41ce-aae6-2a0051c1252b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:30.388726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:30.389615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:30.389966 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:30.390344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:30.391099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:30.392708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:30.404770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 10 15:42:30.412047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 490/971] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Nov 10 15:42:30 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:30.413694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:30.424290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114a3b2-34b7-4b92-8725-1aa41b7b2681 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:30.429289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:30.429998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:30.430242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:30.430542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:30.431265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:30.431557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:30.433271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:30.439331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 482/972] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:30.445570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:30.455872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f1b8c-2807-4bed-bbc8-00d99aa79e51 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:30.460553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:30.461151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:30.461435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:30.461802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:30.462606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:30.462908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:30.464672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff35f9-0264-42ea-9bb2-bbe3c5b77b15 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:30.470739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 491/973] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:30 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:30.477024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:30.488010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589c47-5a74-49ec-ba01-4595e66a7714 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:30.493257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264624-0baa-47d6-a22c-77ceaaab26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:30.493949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264624-0baa-47d6-a22c-77ceaaab26f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:30.494252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264624-0baa-47d6-a22c-77ceaaab26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:30.494509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264624-0baa-47d6-a22c-77ceaaab26f2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:30.495298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa264624-0baa-47d6-a22c-77ceaaab26f2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:30.497465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa264624-0baa-47d6-a22c-77ceaaab26f2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:30.534194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 483/974] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:42:30 2021] POST /identity/v3/endpoints => generated 327 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:32.456675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3759c-b873-42ee-80d7-516db4915c97 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.457524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3759c-b873-42ee-80d7-516db4915c97 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.457524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3759c-b873-42ee-80d7-516db4915c97 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.459385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 492/975] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:42:32.465684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.466376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.466376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.492181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:32.494326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:32.520114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 484/976] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:32.550075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3759c-b873-42ee-80d7-516db4915c97 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.563914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3759c-b873-42ee-80d7-516db4915c97 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.569012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.569830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.570109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.570410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.582603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:32.590178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 15:42:32.591726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 493/977] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:32.598667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.609518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52b52b-95e1-4993-86e9-c8a4ded1ee5b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.614516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.615211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.615499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.615812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.616614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:32.616917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.618591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.633520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 485/978] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:32.641436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.652871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dabb7-3d9a-4d00-a18c-55082a951597 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.658241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.659280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.659668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.659950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.671366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.673524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.692446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:32.693924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 494/979] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:32.701523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.711767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fd7d0-bea7-4dea-8edb-c21d8fcd5135 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.717066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.717835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.718125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.718435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.719221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:32.719532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.721175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.736218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 486/980] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:32.743889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.756696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaf3cb-adbe-4334-8646-eae5c4264c71 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.762465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.763288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.763582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.763844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.774370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.776352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.791246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:42:32.792832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 495/981] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:32.800105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.811614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffe1e2-6151-40d8-abc0-f3cd618006f3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.816388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.817085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.817358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.817665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.818637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:32.818878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.820752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.839403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 487/982] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:32.846012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.856264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee16b5-35ad-4b74-b128-73230d6fcdb6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.861476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.862146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.862451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.862900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.872738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.874650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.884770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 496/983] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:32.891679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.901863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80fe49-ea26-4395-b4af-544daf343621 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.907665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.908486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.908765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.909039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.920470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.922730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.940645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:32.942103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 488/984] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:32.948638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:32.959215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f864e5-9b26-4237-bf8c-e243bde38b37 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:32.964402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:32.965592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:32.965944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:32.966448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:32.967354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:32.967722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:32.969952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:32.988330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 497/985] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:32.990508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.001244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caddd51-da48-4396-9e86-413e303b7cf7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.006024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.006967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.007317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.007667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.016055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.018199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.032661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:33.034089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 489/986] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:33.041007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.052484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b485e-cbf4-4b89-96e4-8a232f83e9ce admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.057419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.058228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.058564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.058840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.059765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:33.060032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.061988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e90e-6b08-4243-92c1-ea7d42628327 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.075979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 498/987] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:33.082924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.094031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939043-711c-4d18-a1fd-e35a7995ce91 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.098815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.099515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.099797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.100066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.100913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] RBAC: Adding query filter params (role.id=1ca253f7b437428eacbe9ba57c5a038c, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=599ea3b3d1f5426ea3218ecb443ca0d0) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:33.101253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.103212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b5764-ed3f-48a1-9cfc-2225e10c2591 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.110232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 490/988] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:33 2021] GET /identity/v3/role_assignments?user.id=599ea3b3d1f5426ea3218ecb443ca0d0&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1ca253f7b437428eacbe9ba57c5a038c => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:33.273555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c93dc-e9d4-40ea-99c9-3af1d9c831ab None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.274046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c93dc-e9d4-40ea-99c9-3af1d9c831ab None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.274566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c93dc-e9d4-40ea-99c9-3af1d9c831ab None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.278441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 499/989] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:33 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:33.289521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.289938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.290542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.324067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:33.326201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:33.340281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 491/990] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:33.387079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c93dc-e9d4-40ea-99c9-3af1d9c831ab None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.406430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c93dc-e9d4-40ea-99c9-3af1d9c831ab None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.413344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3d9ae-d157-4134-b995-a7e7fd0ccbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.414579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d9ae-d157-4134-b995-a7e7fd0ccbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.415000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d9ae-d157-4134-b995-a7e7fd0ccbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.415408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d9ae-d157-4134-b995-a7e7fd0ccbd9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.417328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3d9ae-d157-4134-b995-a7e7fd0ccbd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.420230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3d9ae-d157-4134-b995-a7e7fd0ccbd9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.423610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 500/991] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:33.433898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.450234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11938ef-b02c-4647-8940-b91fc62a4687 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.457999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26877b1-641b-4e99-9b29-9c223ee6020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.459209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26877b1-641b-4e99-9b29-9c223ee6020a admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.459678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26877b1-641b-4e99-9b29-9c223ee6020a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.460138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26877b1-641b-4e99-9b29-9c223ee6020a admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.461474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26877b1-641b-4e99-9b29-9c223ee6020a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.465667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26877b1-641b-4e99-9b29-9c223ee6020a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.506263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 492/992] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:42:33 2021] POST /identity/v3/users => generated 285 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:33.588329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc93ea-62c9-4cd1-8ce0-97fed99245a3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.588870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc93ea-62c9-4cd1-8ce0-97fed99245a3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.589106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc93ea-62c9-4cd1-8ce0-97fed99245a3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.594130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 501/993] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:33 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:33.601261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.601690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.601802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.623359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:33.624623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:33.633932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 493/994] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:33.657901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc93ea-62c9-4cd1-8ce0-97fed99245a3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.672970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc93ea-62c9-4cd1-8ce0-97fed99245a3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.679177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1075-ae08-4481-9e09-4c4f50733d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.679683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1075-ae08-4481-9e09-4c4f50733d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.680047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1075-ae08-4481-9e09-4c4f50733d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.680324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1075-ae08-4481-9e09-4c4f50733d1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.690065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa1075-ae08-4481-9e09-4c4f50733d1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.692078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa1075-ae08-4481-9e09-4c4f50733d1e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.702793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 502/995] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:33 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:33.711988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:33.726791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58cb2b-64fb-4b7d-a54b-52ecbe561e1d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:33.734507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e35c1-31ca-44e1-b937-c267f2393327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:33.736168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e35c1-31ca-44e1-b937-c267f2393327 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:33.736452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e35c1-31ca-44e1-b937-c267f2393327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:33.736754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e35c1-31ca-44e1-b937-c267f2393327 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:33.738094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e35c1-31ca-44e1-b937-c267f2393327 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:33.740083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e35c1-31ca-44e1-b937-c267f2393327 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:33.741886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 494/996] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:35.520302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320810-3209-4f17-80a9-92adf94dc113 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.520875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320810-3209-4f17-80a9-92adf94dc113 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.520875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320810-3209-4f17-80a9-92adf94dc113 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.522579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 503/997] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:35.529032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.529632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.529632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.549912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:35.551154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:35.560275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 495/998] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:35.585280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f320810-3209-4f17-80a9-92adf94dc113 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.601080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f320810-3209-4f17-80a9-92adf94dc113 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.607491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.608381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.608637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.608965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.623582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:35.631371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 15:42:35.632878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 504/999] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:35.642327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.652573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4388184-07ff-4ea1-8f2b-d9f89caefcf9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.658451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.659167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.659634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.659808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.660839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:35.661147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.662893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.673752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 496/1000] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:35.680484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.692033 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295e9f4-3ecd-48ee-90f2-056bc45eb1de admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.697158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.697999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.698351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.698861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.710458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.712333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.730085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:35.731381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 505/1001] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:35.738072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.749610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d155704-b523-4087-9ba0-cd096d33c7ef admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.755839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.756397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.756673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.756935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.757681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:35.757979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.759624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.773177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 497/1002] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:35.779868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.790550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdd6d2-fdcc-4df3-8e5b-73f51226cff2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.796684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.797845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.798116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.798415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.807051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.809174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.824887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:42:35.826131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 506/1003] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:35.833295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.844632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae6542-4da1-40df-b0e2-dbd47d4eee8d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.850189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.850877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.851157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.851431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.852289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:35.852910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.854482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.875758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 498/1004] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:35.882514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.893151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d3032-ba5d-4cb8-97ee-9486e9db5f36 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.898206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.899065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.899421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.899698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.911644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.913634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.931643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:35.938225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 507/1005] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:35.939843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.950873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a039d1-edab-4e85-82d9-a8cafc2895bf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.956415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.957081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.957356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.957632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:35.958382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:35.958719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:35.960336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea4aeb-bb06-4c62-ba5b-14040b37ca22 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:35.973083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 499/1006] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:35.979777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:35.990417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2f91-f357-4947-b7b0-4e34c240652c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:35.995343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:35.996642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:35.996922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:35.997194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.004977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.006991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.020907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a225-5717-4084-8fed-d75118317f97 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.021190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a225-5717-4084-8fed-d75118317f97 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.021302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-84a60adf-e4c4-4de1-bb11-68e13c80237f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:36.021468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680a225-5717-4084-8fed-d75118317f97 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.022723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 508/1007] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:36.023388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 500/1008] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:36.030088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a225-5717-4084-8fed-d75118317f97 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.030342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.030566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.030844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.044413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680a225-5717-4084-8fed-d75118317f97 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.050097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.050784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.050905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:36.051083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.051347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.052010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:36.052127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:36.052438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.054324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.060196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 509/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:36.068044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 501/1010] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:36.075284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.085434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9b9eb-2e1d-4a19-825d-45f05e43c0ff None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.086446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.090679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.091581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.091859 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.092141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/599ea3b3d1f5426ea3218ecb443ca0d0/roles/1ca253f7b437428eacbe9ba57c5a038c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.094441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=599ea3b3d1f5426ea3218ecb443ca0d0, role_id=1ca253f7b437428eacbe9ba57c5a038c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.097110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.097303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0da923-fe79-4616-acc6-2b92de31a565 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.102738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.103780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.104203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.104664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.116323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 510/1011] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:36 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/599ea3b3d1f5426ea3218ecb443ca0d0/roles/1ca253f7b437428eacbe9ba57c5a038c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:42:36.117612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:36.125462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:42:36.126807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 502/1012] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:36.135615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.208679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbd878-bfee-43e4-98e7-6fa731e7e3b6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.213937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.214805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.215062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.215350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.216143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:36.216462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.218260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.227971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 511/1013] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:36.235129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.246388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecef23-80c0-43e1-9489-7ba7957f6e23 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.252709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.254280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.254724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.255192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] PATH_INFO: `/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.272952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] RBAC: Authorizing `identity:get_user(user_id=c8b987e18cc24b9c8ad964ea1e8ca265)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.275274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.277522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 503/1014] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265 => generated 285 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:36.284774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.296461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b2f1f-25a3-4050-914f-072b1a70f157 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.302289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.302965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.303249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.303522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.312829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.314711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.325146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 512/1015] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:36.332228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.344817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baab77a-e48c-4909-a5c3-3312247828bc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.352014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f044616-647a-4c0c-b616-862077182165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.352921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f044616-647a-4c0c-b616-862077182165 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.353203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f044616-647a-4c0c-b616-862077182165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.353470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f044616-647a-4c0c-b616-862077182165 admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.354780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f044616-647a-4c0c-b616-862077182165 admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.356958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f044616-647a-4c0c-b616-862077182165 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.358716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 504/1016] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:36.365822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:36.375401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83095-e088-4ac7-8d9b-6546f8a50305 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:36.380502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:36.381180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:36.381452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:36.381723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:36.382625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=362d90efb4b747d58c8804a0c65f2b88, user.id=c8b987e18cc24b9c8ad964ea1e8ca265) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:36.382929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:36.384838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b3f7a-7337-425c-812e-28d6aa357d11 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:36.390904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 513/1017] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:36 2021] GET /identity/v3/role_assignments?user.id=c8b987e18cc24b9c8ad964ea1e8ca265&scope.project.id=362d90efb4b747d58c8804a0c65f2b88&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:38.575074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf95a-0e4a-40d8-b9b5-010e5a6e42cb None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.575627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf95a-0e4a-40d8-b9b5-010e5a6e42cb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.575627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf95a-0e4a-40d8-b9b5-010e5a6e42cb None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.577353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 505/1018] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:38.584147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.584789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.584789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.605468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:38.606818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:38.615831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 514/1019] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:38.643103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf95a-0e4a-40d8-b9b5-010e5a6e42cb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.657454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf95a-0e4a-40d8-b9b5-010e5a6e42cb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.662058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.662926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.663203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.663476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.675804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:38.683252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 10 15:42:38.684544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 506/1020] 10.222.0.60 () {56 vars in 1141 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:38.691848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.701474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e685c-d591-4af4-8057-aaa185276f48 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.706863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.707524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.707796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.708066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.708851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:38.709147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.710784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e941e4b-89e5-4bf1-a198-52a8ec025f7a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.720093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 515/1021] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:38.727660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.739176 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dd89b-5ba0-4475-8f52-81873db93c88 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.744483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.745690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.746003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.746358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.749971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c33d-daf0-4159-9f91-207d71140f26 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.750670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c33d-daf0-4159-9f91-207d71140f26 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.751120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c33d-daf0-4159-9f91-207d71140f26 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.755495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 516/1022] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:38 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:38.763063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.764834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.765032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.765181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.765390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.785211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:38.786548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:38.787395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:38.788650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 507/1023] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:38.795596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.798977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 517/1024] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:42:38.806041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884631-5dec-4f3a-91c4-5b11952be162 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.811048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.811714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.811989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.812260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.813004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:38.813311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.814954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.827417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 508/1025] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:38.833660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.842500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.844719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b719c4-8d76-4aa9-8af6-67ecaaa5d3ba None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.850493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.851314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.851590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.851862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.852611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37e54-764f-47dc-a43c-cc30f5c1609e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.857434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.858301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.858575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.858862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.860426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.862545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.871407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:38.878038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 10 15:42:38.878239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:42:38.879369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 518/1026] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:38.879707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 509/1027] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:42:38.885984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.887818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.897247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030ad54-f3ae-455c-b444-dfd57d2f6dad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.898688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3950a-1e5d-4be2-9008-ad308dfa362e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.903087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.903765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.904042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.904143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.904310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.904803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.905085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.905187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:38.905355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.905469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.906125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:38.906465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.907377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.908073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.917596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 510/1028] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:38.924889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.928249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 519/1029] 10.222.0.60 () {56 vars in 1154 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:38.935870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc064c-5172-4550-8e87-dd9be215843d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.936093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.943396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.944291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.944571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.944846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] PATH_INFO: `/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.946115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] RBAC: Authorizing `identity:get_user(user_id=c8b987e18cc24b9c8ad964ea1e8ca265)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.946511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9273d4-015c-4fb0-947a-7dafb563bdc4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.948400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.950084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 511/1030] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265 => generated 285 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:38.951612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.952259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.952545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.952819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.956545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.961430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.963232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.966330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265801f6-5251-4e99-9670-10a302537151 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.970940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.971842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.972122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.972387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.972761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 520/1031] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:38.973773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:38.975900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:38.977784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 512/1032] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:38.979665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.984431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:38.988926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568cae-3187-4f0d-8118-2c411e073249 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:38.994360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:38.995153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:38.995779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:38.995779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:38.995987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3134b-4e68-49e7-ad6d-c20e318ef34d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:39.001485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:39.002396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:39.002673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:39.002943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88/users/c8b987e18cc24b9c8ad964ea1e8ca265/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:39.005150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=362d90efb4b747d58c8804a0c65f2b88, user_id=c8b987e18cc24b9c8ad964ea1e8ca265, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:39.006890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:39.008145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:39.008717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:39.022477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 513/1033] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:38 2021] PUT /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88/users/c8b987e18cc24b9c8ad964ea1e8ca265/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:42:39.027905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:42:39.029110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 521/1034] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:39.037015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:39.126275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d724-871f-4d86-a1dd-ff621a2e08fa admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:39.131604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:39.132291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:39.132575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:39.132851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:39.133622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:39.133943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:39.135789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:39.149227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 514/1035] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:42:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:39.156229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:39.166857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590221e6-19fd-46c4-88a3-4c3a045b9186 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:39.171885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:39.173089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:39.173373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:39.173645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:39.181756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:39.183973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:39.198772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:42:39.200492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 522/1036] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:42:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:39.207529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:39.219398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84a9d1-ea33-4d58-ad1e-b772680c19c9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:39.224717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:39.225403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:39.225690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:39.225962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:39.226990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:39.227302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:39.229306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e774-9ec3-4aa5-9cda-2f023b7b2f42 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:39.247986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 515/1037] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:42:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:39.255836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:39.267685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5915a-7fd6-4cf2-abca-a4da84d143c7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:39.273373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:39.273980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:39.274306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:39.274579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:39.275437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] RBAC: Adding query filter params (role.id=1ca253f7b437428eacbe9ba57c5a038c, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=599ea3b3d1f5426ea3218ecb443ca0d0) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:39.275748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:39.278107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec7230-0ffc-4793-8603-87c88097c5f2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:39.284739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 523/1038] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:39 2021] GET /identity/v3/role_assignments?user.id=599ea3b3d1f5426ea3218ecb443ca0d0&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1ca253f7b437428eacbe9ba57c5a038c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:41.381478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc349-d41f-494e-87d7-23c1d7aaf0db None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.382219 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc349-d41f-494e-87d7-23c1d7aaf0db None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.382219 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc349-d41f-494e-87d7-23c1d7aaf0db None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.383937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 516/1039] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:41.391034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.391558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.391558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.411760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:41.413011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:41.423626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 524/1040] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:41.452084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc349-d41f-494e-87d7-23c1d7aaf0db None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:41.467800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc349-d41f-494e-87d7-23c1d7aaf0db None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:41.473622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:41.474474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.474753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.475018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.487559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:42:41.494398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:42:41.495626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 517/1041] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:42:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:42:41.502994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:41.512942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653d69f-e84a-4d16-9f6d-63d7f2438cae None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:41.518450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:41.519147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.519422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.519689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.520466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:41.520762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:41.522456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:41.532579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 525/1042] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:42:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:41.539302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:41.550880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb778c-2323-4df0-8802-b1abbc8ebd2a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:41.556095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:41.556964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.557253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.557526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] PATH_INFO: `/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.558888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=c8b987e18cc24b9c8ad964ea1e8ca265)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:41.561078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:41.562794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 518/1043] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:41 2021] GET /identity/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:41.570101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:41.580879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee51c-8753-4521-90ea-1ab686cc74ab admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:41.586923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:41.587603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.587875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.588141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.597486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:41.599284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:41.609008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 526/1044] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:41.615951 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:41.626664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304152c-77b1-4bfe-9544-6ad4a6a1c0c9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:41.632235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bfdca-3a08-4b43-bc34-9fe79e335415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:41.633130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bfdca-3a08-4b43-bc34-9fe79e335415 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.633414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bfdca-3a08-4b43-bc34-9fe79e335415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.633684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bfdca-3a08-4b43-bc34-9fe79e335415 admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.635029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bfdca-3a08-4b43-bc34-9fe79e335415 admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:41.637279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bfdca-3a08-4b43-bc34-9fe79e335415 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:41.639057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 519/1045] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:42:41 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:41.646027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:41.655375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad07cc-4d83-470a-b667-73978eee0566 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:41.660239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:41.660882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:41.661143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:41.661424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:41.662282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=362d90efb4b747d58c8804a0c65f2b88, user.id=c8b987e18cc24b9c8ad964ea1e8ca265) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:41.662595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:41.664438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b1ee-5844-4e88-9235-0477f8313bc7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:41.671145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 527/1046] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:41 2021] GET /identity/v3/role_assignments?user.id=c8b987e18cc24b9c8ad964ea1e8ca265&scope.project.id=362d90efb4b747d58c8804a0c65f2b88&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:44.051810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39a74-c613-4ffa-b78c-613961d3af62 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:44.052385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39a74-c613-4ffa-b78c-613961d3af62 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:44.052385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39a74-c613-4ffa-b78c-613961d3af62 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:44.054225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 520/1047] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:44.061304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:44.061742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:44.061831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:44.081684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:44.082890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:44.092087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 528/1048] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:44.119905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39a74-c613-4ffa-b78c-613961d3af62 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:44.134964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39a74-c613-4ffa-b78c-613961d3af62 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:44.140232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074be0cd-4d6a-4279-88bc-6212134de63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:44.141046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074be0cd-4d6a-4279-88bc-6212134de63f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:44.141313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074be0cd-4d6a-4279-88bc-6212134de63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:44.141575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074be0cd-4d6a-4279-88bc-6212134de63f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:44.142821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074be0cd-4d6a-4279-88bc-6212134de63f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:44.144508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074be0cd-4d6a-4279-88bc-6212134de63f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:44.146175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 521/1049] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:44.153385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:44.162631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c13d4-19d3-48d1-88b9-bea2f7cfcc97 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:44.167883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd05fa-3564-4eef-9ae7-ed0753888d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:44.168566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd05fa-3564-4eef-9ae7-ed0753888d30 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:44.168841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd05fa-3564-4eef-9ae7-ed0753888d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:44.169109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd05fa-3564-4eef-9ae7-ed0753888d30 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:44.169883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd05fa-3564-4eef-9ae7-ed0753888d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:44.171865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd05fa-3564-4eef-9ae7-ed0753888d30 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:44.196204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 529/1050] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:42:44 2021] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:42:46.541089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3c6e-0872-485a-8e82-3f2834e7c5a0 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.541626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3c6e-0872-485a-8e82-3f2834e7c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.541626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3c6e-0872-485a-8e82-3f2834e7c5a0 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.543375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 522/1051] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:46.550376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.550812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.550943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.570442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:46.571633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:46.581343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 530/1052] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:46.609236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3c6e-0872-485a-8e82-3f2834e7c5a0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:46.623031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3c6e-0872-485a-8e82-3f2834e7c5a0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:46.627676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:46.628534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.628791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.629089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] PATH_INFO: `/v3/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.630720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] RBAC: Authorizing `identity:get_role(role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:46.631737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:46.631737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:42:46.631737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:42:46.632617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:46.634022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 523/1053] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:46 2021] GET /identity/v3/roles/562e684ed61e49f89bb4094923724b9b => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:46.640943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:46.650758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584916f-12a2-4f6d-bcc9-c659243e7cd5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:46.656009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:46.656980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.657267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.657548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] PATH_INFO: `/v3/users/5828f78cda844876aa9296dd7d70d17d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.673722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] RBAC: Authorizing `identity:get_user(user_id=5828f78cda844876aa9296dd7d70d17d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:46.675939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:46.677763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 531/1054] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:46 2021] GET /identity/v3/users/5828f78cda844876aa9296dd7d70d17d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:46.685069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:46.695775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806c98a-0410-420d-bd3b-3c5496f0131d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:46.701560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:46.702216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.702493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.702759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.711187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:46.712948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:46.722318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 524/1055] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:46 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:46.729991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:46.740820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc1e66-96ce-402a-9ba8-48daf949e165 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:46.746728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dbd2b-3fff-4ac1-bd33-62d790ee2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:46.747789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbd2b-3fff-4ac1-bd33-62d790ee2067 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.748239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbd2b-3fff-4ac1-bd33-62d790ee2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.748642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbd2b-3fff-4ac1-bd33-62d790ee2067 admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.750089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbd2b-3fff-4ac1-bd33-62d790ee2067 admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:46.752304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbd2b-3fff-4ac1-bd33-62d790ee2067 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:46.754112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 532/1056] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:42:46 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:46.761859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:46.771550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce86a6-ff9f-4d3a-a56d-8c1b6257183e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:46.777635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:46.778434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:46.778820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:46.779186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:46.780143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] RBAC: Adding query filter params (role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=362d90efb4b747d58c8804a0c65f2b88, user.id=5828f78cda844876aa9296dd7d70d17d) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:46.780545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:46.782593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3879e8-ca52-456d-ac1c-8fd9c23ab922 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:46.788889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 525/1057] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:46 2021] GET /identity/v3/role_assignments?user.id=5828f78cda844876aa9296dd7d70d17d&scope.project.id=362d90efb4b747d58c8804a0c65f2b88&role.id=562e684ed61e49f89bb4094923724b9b => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:49.111981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd8101-f786-4793-aafd-d3d2bd1956a0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:49.112656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd8101-f786-4793-aafd-d3d2bd1956a0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:49.112849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd8101-f786-4793-aafd-d3d2bd1956a0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:49.114653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 533/1058] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:49.121550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:49.122121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:49.122257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:49.142674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:49.143936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:49.153220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 526/1059] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:49.179571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd8101-f786-4793-aafd-d3d2bd1956a0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:49.193985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd8101-f786-4793-aafd-d3d2bd1956a0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:49.199417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:49.200294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:49.200583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:49.200856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] PATH_INFO: `/v3/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:49.202519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] RBAC: Authorizing `identity:get_role(role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:49.203532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:42:49.203532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:42:49.203532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:42:49.204403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:49.205792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 534/1060] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:49 2021] GET /identity/v3/roles/562e684ed61e49f89bb4094923724b9b => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:42:49.212913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:49.222635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313eef5-2c1a-4807-9a50-c97a252c8591 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:49.227900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:49.228778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:49.229054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:49.229321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] PATH_INFO: `/v3/users/5828f78cda844876aa9296dd7d70d17d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:49.231479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=5828f78cda844876aa9296dd7d70d17d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:49.233631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:49.235346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 527/1061] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:49 2021] GET /identity/v3/users/5828f78cda844876aa9296dd7d70d17d => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:49.242277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:49.252575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc93a63-ad22-4a14-9d51-a4413d90a2f4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:49.257651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f907018-70ba-4c53-a494-2803c7936ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:49.258570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907018-70ba-4c53-a494-2803c7936ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:49.258848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907018-70ba-4c53-a494-2803c7936ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:49.259126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907018-70ba-4c53-a494-2803c7936ed8 admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:49.260351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f907018-70ba-4c53-a494-2803c7936ed8 admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:49.263013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f907018-70ba-4c53-a494-2803c7936ed8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:49.264807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 535/1062] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:42:49 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:49.271905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:49.282827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33178af0-0246-4c7f-bec1-d66689e9d2e1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:49.288062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7288f30-f57a-4fce-afc0-4369b58d6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:49.288973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288f30-f57a-4fce-afc0-4369b58d6bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:49.289264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288f30-f57a-4fce-afc0-4369b58d6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:49.289554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288f30-f57a-4fce-afc0-4369b58d6bf6 admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88/users/5828f78cda844876aa9296dd7d70d17d/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:49.292294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288f30-f57a-4fce-afc0-4369b58d6bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362d90efb4b747d58c8804a0c65f2b88, user_id=5828f78cda844876aa9296dd7d70d17d, role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:49.295331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288f30-f57a-4fce-afc0-4369b58d6bf6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:49.312106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 528/1063] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:42:49 2021] PUT /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88/users/5828f78cda844876aa9296dd7d70d17d/roles/562e684ed61e49f89bb4094923724b9b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:42:51.596456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dfee7-cfdb-4be7-b3fc-d8c231e20094 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.597035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dfee7-cfdb-4be7-b3fc-d8c231e20094 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.597035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dfee7-cfdb-4be7-b3fc-d8c231e20094 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.598775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 536/1064] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:51.605425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.605900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.606004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.627122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:51.628375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:51.693465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 529/1065] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:51.721523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dfee7-cfdb-4be7-b3fc-d8c231e20094 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:51.734622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dfee7-cfdb-4be7-b3fc-d8c231e20094 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:51.739279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:51.740208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.740481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.740784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] PATH_INFO: `/v3/roles/562e684ed61e49f89bb4094923724b9b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.742498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] RBAC: Authorizing `identity:get_role(role_id=562e684ed61e49f89bb4094923724b9b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:51.744151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:51.746059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 537/1066] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:51 2021] GET /identity/v3/roles/562e684ed61e49f89bb4094923724b9b => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:51.753339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:51.763567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52404167-5002-439f-b1e2-67f9193823c6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:51.768392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:51.769301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.769579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.769850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] PATH_INFO: `/v3/users/5828f78cda844876aa9296dd7d70d17d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.771221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] RBAC: Authorizing `identity:get_user(user_id=5828f78cda844876aa9296dd7d70d17d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:51.773537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:51.775404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 530/1067] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:42:51 2021] GET /identity/v3/users/5828f78cda844876aa9296dd7d70d17d => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:51.782529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:51.793367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b94895-d052-4299-ad10-439be0eaf8c6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:51.798832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:51.799600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.799888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.800160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.809736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:51.811549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:51.821524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 538/1068] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:42:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:42:51.828933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:51.839412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fc001-8c3f-4a94-8830-0eb3254a9934 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:51.844633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990a07-19d8-4c0b-a76e-4a2212bbe2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:51.845384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990a07-19d8-4c0b-a76e-4a2212bbe2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.845663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990a07-19d8-4c0b-a76e-4a2212bbe2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.845933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990a07-19d8-4c0b-a76e-4a2212bbe2b5 admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.847295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7990a07-19d8-4c0b-a76e-4a2212bbe2b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:51.849307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7990a07-19d8-4c0b-a76e-4a2212bbe2b5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:51.851096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 531/1069] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:42:51 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:51.858587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:51.867892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72a8a-6a50-467b-91d1-3264e353eddd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:51.873742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:51.874436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:51.874702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:51.875051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:51.876107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] RBAC: Adding query filter params (role.id=562e684ed61e49f89bb4094923724b9b, scope.project.id=362d90efb4b747d58c8804a0c65f2b88, user.id=5828f78cda844876aa9296dd7d70d17d) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:42:51.876422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:51.878319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83fe25-c2d4-41ab-92aa-362baf3eb38f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:51.884949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 539/1070] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:42:51 2021] GET /identity/v3/role_assignments?user.id=5828f78cda844876aa9296dd7d70d17d&scope.project.id=362d90efb4b747d58c8804a0c65f2b88&role.id=562e684ed61e49f89bb4094923724b9b => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:54.508524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e63d-8d33-4537-a859-6627c8ac0c2b None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:54.509241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e63d-8d33-4537-a859-6627c8ac0c2b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:54.509241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e63d-8d33-4537-a859-6627c8ac0c2b None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:54.511227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 532/1071] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:54.519070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:54.519841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:54.519841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:54.542877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:54.544684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:54.554296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 540/1072] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:54.592810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e63d-8d33-4537-a859-6627c8ac0c2b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:54.612616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e63d-8d33-4537-a859-6627c8ac0c2b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:54.619243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597b4c8-f1ea-460c-b30e-a2d7f528baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:54.620831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b4c8-f1ea-460c-b30e-a2d7f528baa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:54.621195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b4c8-f1ea-460c-b30e-a2d7f528baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:54.621637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b4c8-f1ea-460c-b30e-a2d7f528baa6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:54.623225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597b4c8-f1ea-460c-b30e-a2d7f528baa6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:54.624959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597b4c8-f1ea-460c-b30e-a2d7f528baa6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:54.626662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 533/1073] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:54.633731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:54.647649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae561d-8123-4da7-9e47-f3479190b050 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:54.653981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da56dd-eb14-4049-a5f8-d7062fa92b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:54.654741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da56dd-eb14-4049-a5f8-d7062fa92b9a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:54.655064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da56dd-eb14-4049-a5f8-d7062fa92b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:54.655387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da56dd-eb14-4049-a5f8-d7062fa92b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:54.656209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da56dd-eb14-4049-a5f8-d7062fa92b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:54.658189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da56dd-eb14-4049-a5f8-d7062fa92b9a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:54.703420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 541/1074] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:42:54 2021] POST /identity/v3/projects => generated 311 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:42:57.746545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6850-7f22-44a4-bb8e-c0b75d25d1ff None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:57.747180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6850-7f22-44a4-bb8e-c0b75d25d1ff None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:57.747180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a6850-7f22-44a4-bb8e-c0b75d25d1ff None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:57.748982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 534/1075] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:42:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:42:57.756608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:57.757195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:57.757396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:57.784334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:42:57.785626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:42:57.865836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 542/1076] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:42:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:42:57.895204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a6850-7f22-44a4-bb8e-c0b75d25d1ff None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:57.910377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a6850-7f22-44a4-bb8e-c0b75d25d1ff None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:57.915721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a4787-edbf-4ded-9586-249426e9c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:57.916633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a4787-edbf-4ded-9586-249426e9c1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:57.917073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a4787-edbf-4ded-9586-249426e9c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:57.917597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a4787-edbf-4ded-9586-249426e9c1e9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:57.919044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a4787-edbf-4ded-9586-249426e9c1e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:57.920868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a4787-edbf-4ded-9586-249426e9c1e9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:57.922948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 535/1077] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:42:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:42:57.930029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:42:57.940196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a899-d8ae-4b80-83db-6d59274fa88f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:42:57.945475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74988d-8467-45db-8d70-7a924d1cdbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:42:57.946315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74988d-8467-45db-8d70-7a924d1cdbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:42:57.946686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74988d-8467-45db-8d70-7a924d1cdbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:42:57.947050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74988d-8467-45db-8d70-7a924d1cdbe3 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:42:57.947876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74988d-8467-45db-8d70-7a924d1cdbe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:42:57.950348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74988d-8467-45db-8d70-7a924d1cdbe3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:42:57.973063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 543/1078] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:42:57 2021] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:43:00.650655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ebb1-a255-43de-a1e9-6e15f73ce046 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.651567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ebb1-a255-43de-a1e9-6e15f73ce046 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.651567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ebb1-a255-43de-a1e9-6e15f73ce046 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.654222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 536/1079] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:00.662522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.663417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.663597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.688577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:00.690007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:00.702487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 544/1080] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:00.742630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ebb1-a255-43de-a1e9-6e15f73ce046 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:00.759337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ebb1-a255-43de-a1e9-6e15f73ce046 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:00.764311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:00.765291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.765533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.765877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.780188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:43:00.787206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:43:00.788458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 537/1081] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:43:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:43:00.797865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:00.814220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b2ffa-dad9-4915-a7a4-32e87de292b2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:00.822450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:00.823580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.824080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.824579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.826100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:00.826695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:00.829769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:00.843156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 545/1082] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:43:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:00.852261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:00.868756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2743-7d25-49b2-a5a6-e8be7d0dfa53 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:00.876177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:00.877503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.877782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.878059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] PATH_INFO: `/v3/users/8dfc13eba3f14f0fa9ec2063303f261e` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.897352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] RBAC: Authorizing `identity:get_user(user_id=8dfc13eba3f14f0fa9ec2063303f261e)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:00.900117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:00.902275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 538/1083] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:43:00 2021] GET /identity/v3/users/8dfc13eba3f14f0fa9ec2063303f261e => generated 286 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:00.909631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:00.923394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93166a-8aab-470c-8617-8aa1f0eb3e51 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:00.928288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:00.928967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.929247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.929522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.939228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:00.941899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:00.952861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 546/1084] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:43:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:43:00.961117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:00.979409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981ef5-1337-47c9-a0bb-439d7fd3b77d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:00.984094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccf366-3387-43f3-a032-66ce0b686ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:00.985414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf366-3387-43f3-a032-66ce0b686ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:00.985833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf366-3387-43f3-a032-66ce0b686ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:00.986209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf366-3387-43f3-a032-66ce0b686ffd admin admin] PATH_INFO: `/v3/projects/5f7137fe87274f71a161236859836d66` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:00.987714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf366-3387-43f3-a032-66ce0b686ffd admin admin] RBAC: Authorizing `identity:get_project(project_id=5f7137fe87274f71a161236859836d66)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:00.990061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf366-3387-43f3-a032-66ce0b686ffd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:00.991910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 539/1085] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:43:00 2021] GET /identity/v3/projects/5f7137fe87274f71a161236859836d66 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:00.999672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:01.010826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5204a7-4786-4fad-894c-eb4e51632ef3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:01.016475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:01.017182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:01.017468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:01.017739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:01.018711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=5f7137fe87274f71a161236859836d66, user.id=8dfc13eba3f14f0fa9ec2063303f261e) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:01.019022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:01.021048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433a6a9-b272-4751-8bfd-a1d675dfe286 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:01.027989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 547/1086] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:43:00 2021] GET /identity/v3/role_assignments?user.id=8dfc13eba3f14f0fa9ec2063303f261e&scope.project.id=5f7137fe87274f71a161236859836d66&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:03.438752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172d8c9-4ab3-4d3f-bc01-3c5f8bc15712 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.439349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172d8c9-4ab3-4d3f-bc01-3c5f8bc15712 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.439349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172d8c9-4ab3-4d3f-bc01-3c5f8bc15712 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.441069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 540/1087] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:43:03.447636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.448152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.448626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.475284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:03.477217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:03.490314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 548/1088] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:03.518707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172d8c9-4ab3-4d3f-bc01-3c5f8bc15712 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:03.532569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172d8c9-4ab3-4d3f-bc01-3c5f8bc15712 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:03.537510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:03.538329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.538603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.539051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.555146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:43:03.562021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:43:03.563286 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 541/1089] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:43:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:43:03.571811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:03.581772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005b08-e114-4091-bbff-16e060503ca4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:03.586798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:03.587475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.587754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.588030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.590489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:03.590823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:03.592475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:03.602351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 549/1090] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:43:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:03.610466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:03.622098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2768-fa57-4ce8-ac08-c42eabc1d11b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:03.628597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:03.629487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.629766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.630038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] PATH_INFO: `/v3/users/8dfc13eba3f14f0fa9ec2063303f261e` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.631437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] RBAC: Authorizing `identity:get_user(user_id=8dfc13eba3f14f0fa9ec2063303f261e)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:03.633604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:03.635342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 542/1091] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:43:03 2021] GET /identity/v3/users/8dfc13eba3f14f0fa9ec2063303f261e => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:03.642618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:03.653286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683d52b-5709-422f-b368-cf67dcdfb746 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:03.658612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ba369-e20b-4d7d-95cb-a5289eb4f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:03.659480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ba369-e20b-4d7d-95cb-a5289eb4f82a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.659756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ba369-e20b-4d7d-95cb-a5289eb4f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.660035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ba369-e20b-4d7d-95cb-a5289eb4f82a admin admin] PATH_INFO: `/v3/projects/5f7137fe87274f71a161236859836d66` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.661274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ba369-e20b-4d7d-95cb-a5289eb4f82a admin admin] RBAC: Authorizing `identity:get_project(project_id=5f7137fe87274f71a161236859836d66)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:03.663386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ba369-e20b-4d7d-95cb-a5289eb4f82a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:03.665148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 550/1092] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:43:03 2021] GET /identity/v3/projects/5f7137fe87274f71a161236859836d66 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:03.672639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:03.683044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9368c2-6139-492f-b73a-edc61180b241 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:03.687841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462a867-2c6e-46d0-9bf1-f17b4845c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:03.688743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462a867-2c6e-46d0-9bf1-f17b4845c1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:03.689027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462a867-2c6e-46d0-9bf1-f17b4845c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:03.689298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462a867-2c6e-46d0-9bf1-f17b4845c1b3 admin admin] PATH_INFO: `/v3/projects/5f7137fe87274f71a161236859836d66/users/8dfc13eba3f14f0fa9ec2063303f261e/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:03.692111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462a867-2c6e-46d0-9bf1-f17b4845c1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7137fe87274f71a161236859836d66, user_id=8dfc13eba3f14f0fa9ec2063303f261e, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:03.695510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462a867-2c6e-46d0-9bf1-f17b4845c1b3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:03.709937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 543/1093] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:43:03 2021] PUT /identity/v3/projects/5f7137fe87274f71a161236859836d66/users/8dfc13eba3f14f0fa9ec2063303f261e/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:43:06.049893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52a39-6a93-4ac8-a186-adb869b600cc None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.050467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52a39-6a93-4ac8-a186-adb869b600cc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.050467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52a39-6a93-4ac8-a186-adb869b600cc None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.052322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 551/1094] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:06.058840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.059600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.059780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.079457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:06.080727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:06.159041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 544/1095] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:06.187311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52a39-6a93-4ac8-a186-adb869b600cc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:06.201269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52a39-6a93-4ac8-a186-adb869b600cc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:06.205854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:06.206699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.206995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.207266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.220278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:43:06.227540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:43:06.228832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 552/1096] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:43:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:43:06.236579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:06.249859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acff10-36d3-4e89-a5c5-3ddbe372ec8f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:06.255270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:06.256021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.256342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.256663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.257497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:06.257849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:06.259611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:06.269923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 545/1097] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:43:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:06.278015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:06.297465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442730c-4057-4d18-be4b-ad522e0f2f06 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:06.305017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:06.306403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.306849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.307312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] PATH_INFO: `/v3/users/8dfc13eba3f14f0fa9ec2063303f261e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.309408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] RBAC: Authorizing `identity:get_user(user_id=8dfc13eba3f14f0fa9ec2063303f261e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:06.312871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:06.314868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 553/1098] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:43:06 2021] GET /identity/v3/users/8dfc13eba3f14f0fa9ec2063303f261e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:43:06.323050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:06.334028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60512f46-88f8-45eb-9c16-fb470c8aa536 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:06.339539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:06.340202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.340485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.340765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.352328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:06.354222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:06.363757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 546/1099] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:43:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:43:06.370995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:06.381305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c8e34-633c-4c2a-8b48-74ae59184ac5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:06.386725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0d18d-4cd0-413d-85d6-79fe3ce38612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:06.387888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d18d-4cd0-413d-85d6-79fe3ce38612 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.387888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d18d-4cd0-413d-85d6-79fe3ce38612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.388237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0d18d-4cd0-413d-85d6-79fe3ce38612 admin admin] PATH_INFO: `/v3/projects/5f7137fe87274f71a161236859836d66` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.389356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0d18d-4cd0-413d-85d6-79fe3ce38612 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f7137fe87274f71a161236859836d66)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:06.391456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0d18d-4cd0-413d-85d6-79fe3ce38612 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:06.393160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 554/1100] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:43:06 2021] GET /identity/v3/projects/5f7137fe87274f71a161236859836d66 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:06.400641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:06.411473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9657d6-0463-4144-9ee2-9785084a6dc9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:06.418184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:06.418865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:06.419146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:06.419426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:06.420271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=5f7137fe87274f71a161236859836d66, user.id=8dfc13eba3f14f0fa9ec2063303f261e) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:06.420588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:06.422831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef74f-b91a-4a94-b73e-f4edfc374296 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:06.429504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 547/1101] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:43:06 2021] GET /identity/v3/role_assignments?user.id=8dfc13eba3f14f0fa9ec2063303f261e&scope.project.id=5f7137fe87274f71a161236859836d66&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:08.815242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932164-3240-4425-a2ea-172c37a3ba69 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:08.815841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932164-3240-4425-a2ea-172c37a3ba69 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:08.815841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932164-3240-4425-a2ea-172c37a3ba69 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:08.817680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 555/1102] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:08.824812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:08.825323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:08.825323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:08.846384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:08.847608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:08.857492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 548/1103] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:08.881911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9932164-3240-4425-a2ea-172c37a3ba69 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:08.897532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9932164-3240-4425-a2ea-172c37a3ba69 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:08.904500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:08.905520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:08.905821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:08.906236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:08.917538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:08.919507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:08.930698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 556/1104] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:43:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:43:08.939552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:08.949896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c26c5-d349-44d7-ba1d-71860b98235b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:08.956821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:08.957649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:08.957927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:08.958187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:08.966444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:08.968287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:08.984252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-27bf3532-41be-440a-819a-207ae545d365 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 10 15:43:08.985520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 549/1105] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:43:08 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:43:08.993610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:09.003714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a18b-2dc2-40a3-bf24-fcdb8029a768 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:09.009021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:09.009706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:09.009979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:09.010282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:09.011573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:09.011895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:09.013592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270afbbf-c387-4aac-ae7a-94714c35b242 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:09.023644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 557/1106] 10.222.0.60 () {56 vars in 1136 bytes} [Wed Nov 10 15:43:08 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:11.343883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194259b-cf2e-4f63-91f7-0dc27162c8a8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:11.344429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194259b-cf2e-4f63-91f7-0dc27162c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:11.344429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194259b-cf2e-4f63-91f7-0dc27162c8a8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:11.346525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 550/1107] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:11.353036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784290-7017-4ac6-8a8a-433118c154c3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:11.353473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784290-7017-4ac6-8a8a-433118c154c3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:11.353562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784290-7017-4ac6-8a8a-433118c154c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:11.374131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-02784290-7017-4ac6-8a8a-433118c154c3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:11.375386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-02784290-7017-4ac6-8a8a-433118c154c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:11.384539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 558/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:11.410095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194259b-cf2e-4f63-91f7-0dc27162c8a8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:11.424979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194259b-cf2e-4f63-91f7-0dc27162c8a8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:11.429365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:11.430024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:11.430332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:11.430603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:11.431365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:11.432535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:43:11.432535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:43:11.432535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:43:11.433427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab47548-8af1-46f9-8c3d-3261d5a1f132 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:11.450262 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 551/1109] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Nov 10 15:43:11 2021] POST /identity/v3/domains => generated 267 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:43:13.796517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14c4d-9d3a-47bc-afa8-cf1a3c5e04b4 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:13.797120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14c4d-9d3a-47bc-afa8-cf1a3c5e04b4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:13.797120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc14c4d-9d3a-47bc-afa8-cf1a3c5e04b4 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:13.798945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 559/1110] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:13.806020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:13.806576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:13.806576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:13.826095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:13.827355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:13.886355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 552/1111] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:13.913088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14c4d-9d3a-47bc-afa8-cf1a3c5e04b4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:13.927770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc14c4d-9d3a-47bc-afa8-cf1a3c5e04b4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:13.932787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494dead-11bc-4b87-b477-2910a3bccab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:13.933680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494dead-11bc-4b87-b477-2910a3bccab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:13.933955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494dead-11bc-4b87-b477-2910a3bccab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:13.934270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494dead-11bc-4b87-b477-2910a3bccab5 admin admin] PATH_INFO: `/v3/domains/1c50f837c7f14c998ec9744601888758` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:13.950226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494dead-11bc-4b87-b477-2910a3bccab5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1c50f837c7f14c998ec9744601888758)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:13.952285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494dead-11bc-4b87-b477-2910a3bccab5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:13.954040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 560/1112] 10.222.0.60 () {56 vars in 1204 bytes} [Wed Nov 10 15:43:13 2021] GET /identity/v3/domains/1c50f837c7f14c998ec9744601888758 => generated 267 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:13.961072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:13.975502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768012-6ecb-4092-ac6c-3e8c54345b19 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:13.981193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7121-9e00-45b5-bc16-f1a28cbaa86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:13.981855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7121-9e00-45b5-bc16-f1a28cbaa86b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:13.982131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7121-9e00-45b5-bc16-f1a28cbaa86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:13.982436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7121-9e00-45b5-bc16-f1a28cbaa86b admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:13.983172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c7121-9e00-45b5-bc16-f1a28cbaa86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:13.985088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c7121-9e00-45b5-bc16-f1a28cbaa86b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:14.013312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 553/1113] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:43:13 2021] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:43:16.456063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094bb9-72f3-4957-aa14-3a33ccf7dc28 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:16.456822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094bb9-72f3-4957-aa14-3a33ccf7dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:16.456822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094bb9-72f3-4957-aa14-3a33ccf7dc28 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:16.458661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 561/1114] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:43:16.467774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:16.468476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:16.468476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:16.490316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:16.491541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:16.560306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 554/1115] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:16.605338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2094bb9-72f3-4957-aa14-3a33ccf7dc28 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:16.630977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2094bb9-72f3-4957-aa14-3a33ccf7dc28 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:16.636229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677b0ef-7fbf-42a3-9911-885e15db2cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:16.637132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b0ef-7fbf-42a3-9911-885e15db2cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:16.637402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b0ef-7fbf-42a3-9911-885e15db2cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:16.637873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677b0ef-7fbf-42a3-9911-885e15db2cc5 admin admin] PATH_INFO: `/v3/domains/1c50f837c7f14c998ec9744601888758` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:16.639694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677b0ef-7fbf-42a3-9911-885e15db2cc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1c50f837c7f14c998ec9744601888758)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:16.641690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677b0ef-7fbf-42a3-9911-885e15db2cc5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:16.644063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 562/1116] 10.222.0.60 () {56 vars in 1204 bytes} [Wed Nov 10 15:43:16 2021] GET /identity/v3/domains/1c50f837c7f14c998ec9744601888758 => generated 267 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:16.651166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:16.660691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea571b8-220a-4863-a00e-7f2993372fde None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:16.665578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e150855-4a08-41ec-8fbd-ecc30f87d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:16.666386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e150855-4a08-41ec-8fbd-ecc30f87d429 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:16.666671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e150855-4a08-41ec-8fbd-ecc30f87d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:16.666947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e150855-4a08-41ec-8fbd-ecc30f87d429 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:16.667694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e150855-4a08-41ec-8fbd-ecc30f87d429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:16.669650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e150855-4a08-41ec-8fbd-ecc30f87d429 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:16.697942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 555/1117] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:43:16 2021] POST /identity/v3/users => generated 311 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:43:19.224615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45defbc-5c25-4263-b2da-658d0310a32e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.225173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45defbc-5c25-4263-b2da-658d0310a32e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.225173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45defbc-5c25-4263-b2da-658d0310a32e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.227019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 563/1118] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:19.233757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.234301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.234395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.256176 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:19.257982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:19.268212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 556/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:19.300175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45defbc-5c25-4263-b2da-658d0310a32e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:19.313509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45defbc-5c25-4263-b2da-658d0310a32e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:19.318310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:19.319106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.319384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.319656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.334552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:43:19.345284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:43:19.347105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 564/1120] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:43:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:43:19.354986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:19.364617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09679e66-d939-458a-a20e-6d0310fdfa4c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:19.369649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:19.370399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.370739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.371061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.371884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:19.372228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:19.373925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:19.388910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 557/1121] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:43:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:19.399982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:19.414376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7db02-d6a4-46af-9eec-bd804688bd35 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:19.422503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:19.423849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.424351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.424844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] PATH_INFO: `/v3/users/af05d316095d45139a767f8f28d35632` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.455175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] RBAC: Authorizing `identity:get_user(user_id=af05d316095d45139a767f8f28d35632)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:19.457372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:19.459230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 565/1122] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:43:19 2021] GET /identity/v3/users/af05d316095d45139a767f8f28d35632 => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:19.467502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:19.489130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e1fce-baed-4ecb-9f10-8b699bed9142 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:19.497537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:19.498716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.499216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.499715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.515236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:19.518779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:19.536046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 558/1123] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:43:19 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:43:19.544021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:19.556163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a8b2b-8f09-4174-9281-aa5d9a373b1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:19.562700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113396f-6dcb-4e59-9812-513bcf927d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:19.563592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113396f-6dcb-4e59-9812-513bcf927d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.563854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113396f-6dcb-4e59-9812-513bcf927d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.564180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113396f-6dcb-4e59-9812-513bcf927d15 admin admin] PATH_INFO: `/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.565851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113396f-6dcb-4e59-9812-513bcf927d15 admin admin] RBAC: Authorizing `identity:get_project(project_id=8cf256a8ab1a4331badc15e5fb8b7c67)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:19.568267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113396f-6dcb-4e59-9812-513bcf927d15 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:19.570079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 566/1124] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:43:19 2021] GET /identity/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67 => generated 361 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:19.579080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:19.594126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f9a7b-124a-4ea4-80a6-5971bbc6b97c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:19.600860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:19.601512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:19.601788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:19.602066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:19.602956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=8cf256a8ab1a4331badc15e5fb8b7c67, user.id=af05d316095d45139a767f8f28d35632) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:19.603255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:19.605439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967b2e-2126-4897-a967-b22975e9ce16 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:19.614265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 559/1125] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:43:19 2021] GET /identity/v3/role_assignments?user.id=af05d316095d45139a767f8f28d35632&scope.project.id=8cf256a8ab1a4331badc15e5fb8b7c67&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:22.048575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c800-0164-4ec7-aea3-f8ed449d79a6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.049198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c800-0164-4ec7-aea3-f8ed449d79a6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.049198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c800-0164-4ec7-aea3-f8ed449d79a6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.051272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 567/1126] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:43:22.058573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f80267-343b-48e9-9870-fc5455670338 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.059321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f80267-343b-48e9-9870-fc5455670338 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.059473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f80267-343b-48e9-9870-fc5455670338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.084661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-16f80267-343b-48e9-9870-fc5455670338 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:22.086405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-16f80267-343b-48e9-9870-fc5455670338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:22.098018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 560/1127] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:22.122996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c800-0164-4ec7-aea3-f8ed449d79a6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:22.141638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c800-0164-4ec7-aea3-f8ed449d79a6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:22.147052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:22.147861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.148143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.148419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.168037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:43:22.176019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:43:22.177369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 568/1128] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:43:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:43:22.186621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f80267-343b-48e9-9870-fc5455670338 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:22.200723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f80267-343b-48e9-9870-fc5455670338 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:22.207633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:22.208344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.208624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.208893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.209686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:22.209990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:22.211733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:22.222217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 561/1129] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:43:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:22.230802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:22.243628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12bdb2-2e6e-4cbb-979a-4bf20a4a3d13 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:22.249725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:22.250741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.251019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.251292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] PATH_INFO: `/v3/users/af05d316095d45139a767f8f28d35632` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.252603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] RBAC: Authorizing `identity:get_user(user_id=af05d316095d45139a767f8f28d35632)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:22.254904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:22.256662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 569/1130] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:43:22 2021] GET /identity/v3/users/af05d316095d45139a767f8f28d35632 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:22.264009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:22.275618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b0088-28a1-4e89-aaf5-5aa99d67a236 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:22.281286 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce52e7-d875-4aa0-8965-c7603d2f545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:22.282271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce52e7-d875-4aa0-8965-c7603d2f545b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.282550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce52e7-d875-4aa0-8965-c7603d2f545b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.282838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce52e7-d875-4aa0-8965-c7603d2f545b admin admin] PATH_INFO: `/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.284203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce52e7-d875-4aa0-8965-c7603d2f545b admin admin] RBAC: Authorizing `identity:get_project(project_id=8cf256a8ab1a4331badc15e5fb8b7c67)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:22.286605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce52e7-d875-4aa0-8965-c7603d2f545b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:22.288386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 562/1131] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:43:22 2021] GET /identity/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67 => generated 361 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:22.296711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:22.314651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab7aca-6f48-4e2d-9222-18820f8c2b0f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:22.322972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7c6f-680e-461a-80d0-2d02aa14ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:22.324617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7c6f-680e-461a-80d0-2d02aa14ff01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:22.325111 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7c6f-680e-461a-80d0-2d02aa14ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:22.325602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7c6f-680e-461a-80d0-2d02aa14ff01 admin admin] PATH_INFO: `/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67/users/af05d316095d45139a767f8f28d35632/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:22.329721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca7c6f-680e-461a-80d0-2d02aa14ff01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf256a8ab1a4331badc15e5fb8b7c67, user_id=af05d316095d45139a767f8f28d35632, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:22.335284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca7c6f-680e-461a-80d0-2d02aa14ff01 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:22.356860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 570/1132] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:43:22 2021] PUT /identity/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67/users/af05d316095d45139a767f8f28d35632/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:43:24.724919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff16b00-b579-455d-af62-46fa301d61b0 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:24.725487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff16b00-b579-455d-af62-46fa301d61b0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:24.725487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff16b00-b579-455d-af62-46fa301d61b0 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:24.727276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 563/1133] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:43:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:43:24.735352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:24.736121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:24.736121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:24.757786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:43:24.759394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:43:24.828380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 571/1134] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:43:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:43:24.854970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff16b00-b579-455d-af62-46fa301d61b0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:24.867782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff16b00-b579-455d-af62-46fa301d61b0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:24.873033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:24.873827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:24.874106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:24.874378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:24.886946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:43:24.896779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:43:24.898056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 564/1135] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:43:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:43:24.905890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:24.915671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ebeaa-6fb3-41b3-a78c-ee13a6347b2b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:24.922989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:24.924000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:24.924329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:24.924641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:24.925477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:24.925822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:24.927523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:24.937358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 572/1136] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:43:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:24.944650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:24.955620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e85637-fb15-43f6-b9c8-90d4e6f10cb8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:24.960741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:24.961590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:24.961892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:24.962186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] PATH_INFO: `/v3/users/af05d316095d45139a767f8f28d35632` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:24.963482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] RBAC: Authorizing `identity:get_user(user_id=af05d316095d45139a767f8f28d35632)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:24.965655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:24.967389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 565/1137] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:43:24 2021] GET /identity/v3/users/af05d316095d45139a767f8f28d35632 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:24.974720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:24.985519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8ac5e-8e48-4c1f-970e-d9e839fa07bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:24.991150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:24.991805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:24.992090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:24.992369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:25.001495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:25.003337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:25.012957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 573/1138] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:43:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:43:25.020062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:25.030405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5874b3-7109-4607-994c-3b09455d7b99 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:25.035260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddac68-e617-4e19-94ad-87b6556d9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:25.036143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddac68-e617-4e19-94ad-87b6556d9bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:25.036424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddac68-e617-4e19-94ad-87b6556d9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:25.036697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddac68-e617-4e19-94ad-87b6556d9bb6 admin admin] PATH_INFO: `/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:25.039114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddac68-e617-4e19-94ad-87b6556d9bb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8cf256a8ab1a4331badc15e5fb8b7c67)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:25.041590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddac68-e617-4e19-94ad-87b6556d9bb6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:25.043352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 566/1139] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:43:25 2021] GET /identity/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67 => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:43:25.050940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:43:25.060752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79160baf-7aae-4e5c-a1d3-b96e51562ecf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:43:25.066305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:43:25.066944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:43:25.067209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:43:25.067490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:43:25.068336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=8cf256a8ab1a4331badc15e5fb8b7c67, user.id=af05d316095d45139a767f8f28d35632) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:43:25.068650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:43:25.070618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ae799-5bf6-4141-85da-21eee943b53a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:43:25.077211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 574/1140] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:43:25 2021] GET /identity/v3/role_assignments?user.id=af05d316095d45139a767f8f28d35632&scope.project.id=8cf256a8ab1a4331badc15e5fb8b7c67&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:27.519995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84d7d-866c-43df-ada7-bac4d5a5a70f None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:27.520708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84d7d-866c-43df-ada7-bac4d5a5a70f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:27.520708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84d7d-866c-43df-ada7-bac4d5a5a70f None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:27.522471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 567/1141] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:27.529495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:27.530152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:27.530152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:27.557185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:27.558919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:27.586200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 575/1142] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:27.612937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84d7d-866c-43df-ada7-bac4d5a5a70f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:27.627502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84d7d-866c-43df-ada7-bac4d5a5a70f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:27.634111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:27.635642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:27.636180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:27.636721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:27.650511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:27.652881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:27.674245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:27.676050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 568/1143] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:27.684005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:27.700975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298346e-7308-4efa-b638-07f32479cf9c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:27.706631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:27.707758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:27.708442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:27.708925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:27.709913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:27.710576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:27.712790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617cfd6-1988-43ad-9228-d4238deeca63 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:27.736069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 576/1144] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:27.738379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:27.750582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1742-2973-4e3e-ba34-1a3b6312901e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:27.756388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28716f7-8257-4dd5-bb77-498b4bbed5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:27.757485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28716f7-8257-4dd5-bb77-498b4bbed5fa admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:27.758210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28716f7-8257-4dd5-bb77-498b4bbed5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:27.758790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28716f7-8257-4dd5-bb77-498b4bbed5fa admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:27.759833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28716f7-8257-4dd5-bb77-498b4bbed5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:27.762275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28716f7-8257-4dd5-bb77-498b4bbed5fa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:27.794990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 569/1145] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Nov 10 15:44:27 2021] POST /identity/v3/users => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:44:30.380005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9fc7-e6ed-4a77-a76f-f3f1c0187b03 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.380856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9fc7-e6ed-4a77-a76f-f3f1c0187b03 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.380856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9fc7-e6ed-4a77-a76f-f3f1c0187b03 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.382493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 577/1146] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:44:30.389765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.390836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.390836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.410307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:30.411510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:30.423390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 570/1147] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:44:30.452856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed9fc7-e6ed-4a77-a76f-f3f1c0187b03 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.472372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed9fc7-e6ed-4a77-a76f-f3f1c0187b03 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.478031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.479195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.479433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.479735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.497781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:44:30.504978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:44:30.506330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 578/1148] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:30.513800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.523997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd635c-4280-49a6-a735-6e3d7a8f5689 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.530000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.531719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.531719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.531719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.534839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:30.536067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.538948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.552269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 571/1149] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:30.561086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.578172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4d68-7648-40d1-bf25-1eafa6c26000 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.585592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.587069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.587421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.587661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.605028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.607384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.630195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:30.637913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 579/1150] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:30.641957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.654528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f18f8d-816b-40e5-b46c-fe1dfa365c3f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.659725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.660560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.660849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.661130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.661941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:30.662244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.663881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.682542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 572/1151] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:30.689196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.700443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357da7d-3d64-45a4-a95b-a1b7307b42d3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.707713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.708551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.708816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.709090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.719237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.722232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.739657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 15:44:30.741252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 580/1152] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:30.748310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.763825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02a00-9435-4de9-abed-e8803d923119 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.769797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.770514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.771053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.771553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.772448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:30.772777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.774910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.802454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 573/1153] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:30.807168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.827551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51e894-a5f0-4d7f-b2a0-92267604d117 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.835007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.836144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.836736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.837261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.850817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.854834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.881396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 581/1154] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:44:30.884087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.897731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392046-e3ae-4ee7-a6bb-140524b2836f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.904095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.904930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.905214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.905483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.921678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.924112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.945163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:30.947026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 574/1155] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:30.954412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:30.968396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7674b2-a94f-4b8b-9f06-da36a81d6889 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:30.974994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:30.976226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:30.977645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:30.977645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:30.978660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:30.979310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:30.982004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:30.998902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 582/1156] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:31.008563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:31.026480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69ef91-b67c-4e4b-b5f4-d45a13b81e0e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:31.031797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:31.032921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:31.033144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:31.033632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:31.042556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:31.044859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:31.061742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:44:31.069913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 575/1157] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:44:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:31.071860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:31.084199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90b703-2584-452f-bbef-7d2838907a11 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:31.090807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:31.092677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:31.093055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:31.093561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:31.094852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:31.095359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:31.097976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7761cd-df89-4601-8b9f-4eb79eb1cfef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:31.117242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 583/1158] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:44:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:31.124572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:31.138954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed85605-2c26-4bc8-bad9-f80be08c3e2f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:31.145848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:31.146931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:31.147337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:31.147577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:31.148557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=e88500f303d44f67a828798654c72b46) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:31.149015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:31.151352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9923f-01a2-4374-b344-9f4dd8e8ee17 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:31.158402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 576/1159] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:44:31 2021] GET /identity/v3/role_assignments?user.id=e88500f303d44f67a828798654c72b46&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:33.704494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151c02-d375-44cd-92b3-d287cc7ae937 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:33.706600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151c02-d375-44cd-92b3-d287cc7ae937 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:33.706600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3151c02-d375-44cd-92b3-d287cc7ae937 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:33.707450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 584/1160] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:33.716964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:33.717824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:33.717997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:33.745652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:33.747520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:33.759739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 577/1161] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:33.793204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3151c02-d375-44cd-92b3-d287cc7ae937 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:33.813613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3151c02-d375-44cd-92b3-d287cc7ae937 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:33.821096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:33.822191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:33.822515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:33.822851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:33.842820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:44:33.856480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:44:33.858749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 585/1162] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:44:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:33.870665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:33.888719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcc5c7-c6a3-4a36-af98-3134fa51abd2 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:33.895443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:33.896153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:33.896425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:33.896708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:33.897587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:33.897934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:33.900260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:33.911437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 578/1163] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:44:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:33.918587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:33.929371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2967b7-0f64-43b6-9df5-d42cb2f26fc6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:33.935272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:33.935986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:33.936265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:33.936538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:33.951770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:33.952016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:33.973038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:33.974997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 586/1164] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:33.988122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.000978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0d036-6f7e-4ec4-bb77-5284395b1ac6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.006296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.006966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.007250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.007679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.008342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:34.008648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.010298 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.026636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 579/1165] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:34.033411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.045733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dabeb-a32c-4932-8b87-fa334fec488d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.051767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.052621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.052896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.053164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.063364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.065431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.081677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 15:44:34.083103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 587/1166] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:34.092276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.107310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02609fa9-9dbe-4db9-b2e4-beab11e4be32 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.112262 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.112942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.113217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.113496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.114418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:34.114728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.116783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.150255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 580/1167] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Nov 10 15:44:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:34.157756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.169929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4089-79bd-4a06-af60-a0e551d7598b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.176072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.177041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.177404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.177853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.191436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.193720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.215203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:34.215647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 588/1168] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:34.223614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.236852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab00ae-058e-48ca-a24e-130556ab8ee0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.243411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.244208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.244562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.244805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.245637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:34.245950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.247758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.263196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 581/1169] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:34.271572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.284947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f203-dee5-468a-bad7-ff39217b2f84 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.291985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.293261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.293673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.294410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.304160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.306897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.323480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:44:34.325142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 589/1170] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:44:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:34.333149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.343995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1be2-d567-4ee9-a2be-05e0385e5c33 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.349413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.350073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.350383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.350658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.351584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:34.351985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.353877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf9bd-e1f9-48b7-9e17-b70596804465 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.371449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 582/1171] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:44:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:34.378628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:34.390833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b479f-714c-418e-8c92-938fc2f93740 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:34.395520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf17d5-618a-4c77-a562-9b41ecd685f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:34.396474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf17d5-618a-4c77-a562-9b41ecd685f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:34.396748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf17d5-618a-4c77-a562-9b41ecd685f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:34.397019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf17d5-618a-4c77-a562-9b41ecd685f9 admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/e88500f303d44f67a828798654c72b46/roles/1aa72f0e321b4290b71c4802f92f1b31` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:34.420278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf17d5-618a-4c77-a562-9b41ecd685f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=e88500f303d44f67a828798654c72b46, role_id=1aa72f0e321b4290b71c4802f92f1b31)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:34.423499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf17d5-618a-4c77-a562-9b41ecd685f9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:34.440342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 590/1172] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:44:34 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/e88500f303d44f67a828798654c72b46/roles/1aa72f0e321b4290b71c4802f92f1b31 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:44:37.069702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee314-09d2-498c-9fad-135e8539b69b None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.070499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee314-09d2-498c-9fad-135e8539b69b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.070658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee314-09d2-498c-9fad-135e8539b69b None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.072838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 583/1173] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:37.079967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.080511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.080511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.107053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:37.109160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:37.178582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 591/1174] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:37.209940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fee314-09d2-498c-9fad-135e8539b69b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.233775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fee314-09d2-498c-9fad-135e8539b69b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.245329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.247348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.247571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.248046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.270454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:44:37.279621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 10 15:44:37.281090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 584/1175] 10.222.0.60 () {56 vars in 1123 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:37.290387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.305232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620da0d-b4e4-4936-bc60-552dd365d6a0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.312721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.313855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.314378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.314857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.316243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:37.316642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.318589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.330695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 592/1176] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:37.338813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.354396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9041-8209-41f5-bc81-4b004b9b7671 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.360442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.361277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.361626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.361836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.377549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.379639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.402879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:37.404700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 585/1177] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:37.412821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.428586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498410ff-2c14-4c34-8520-98a5c3e2db58 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.433887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.434618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.434938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.435218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.436176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:37.436502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.438148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.460036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 593/1178] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:37.461495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.472636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b80d-eb1a-4fa9-abc4-6ba8ba7c8657 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.477861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.478759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.479036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.479312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.488470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.490873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.508093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 15:44:37.509486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 586/1179] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:37.516428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.529779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672212a5-f1be-4401-ba9c-f1fc1e4e7bc6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.534995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.535699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.536091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.536262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.537131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:37.537417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.539366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.558987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 594/1180] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:37.570338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.588108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98b6f-ad16-460e-8ca4-9d9cba60ecfa admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.594348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.595168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.595578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.595964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.607225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.609007 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.619149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 587/1181] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:44:37.626300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.637135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044825ba-0883-4161-b64e-aed64ce2d318 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.643139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.643925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.644199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.644500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.657024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.659344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.683461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:37.684623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 595/1182] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:37.691590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.703886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318873-c497-4fd4-b613-b5be917a5371 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.708710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.709381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.709656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.709929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.710798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:37.711733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.714734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.727569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 588/1183] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:44:37.733883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.745152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080347eb-a3c9-4d63-b1b7-c97a137169a3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.750430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.751291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.751548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.751786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.759633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.762259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.782502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:44:37.783849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 596/1184] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:37.792397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.809596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48b71-ecd1-4061-a1e6-b41d9a0a8274 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.820419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.821710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.822256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.822753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.824233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:37.824778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.828351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65734a86-dd92-461c-b650-f8ddcf5b528c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.845382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 589/1185] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:37.853672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:37.866814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3186b-30bf-4f5f-ad18-75703beeac01 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:37.872115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:37.872794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:37.873074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:37.873359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:37.874250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] RBAC: Adding query filter params (role.id=1aa72f0e321b4290b71c4802f92f1b31, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=e88500f303d44f67a828798654c72b46) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:37.874568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:37.876778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bce2f5-7b9d-4334-b6e3-6b40a9e1516a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:37.884813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 597/1186] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:44:37 2021] GET /identity/v3/role_assignments?user.id=e88500f303d44f67a828798654c72b46&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=1aa72f0e321b4290b71c4802f92f1b31 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:40.727586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42573c02-e542-42a1-aae0-1ed318681639 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:40.728218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42573c02-e542-42a1-aae0-1ed318681639 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:40.728218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42573c02-e542-42a1-aae0-1ed318681639 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:40.730085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 590/1187] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:40.737702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:40.738602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:40.738602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:40.759771 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:40.761020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:40.769074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 598/1188] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:40.803561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42573c02-e542-42a1-aae0-1ed318681639 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:40.822739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42573c02-e542-42a1-aae0-1ed318681639 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:40.829991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:40.831364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:40.831742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:40.832123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:40.852663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:44:40.861919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:44:40.863435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 591/1189] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:44:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:40.871165 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:40.882132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e629608-1e08-4d9d-9f0a-c218b0052933 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:40.889755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:40.891053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:40.891402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:40.891735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:40.892948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:40.893361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:40.895337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:40.908056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 599/1190] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:44:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:40.915644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:40.932195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc8a36-9e09-47a4-91da-19a16e4ac231 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:40.942211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:40.943700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:40.944211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:40.944627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:40.964080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:40.966975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:40.991753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:40.993602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 592/1191] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:41.002047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.018193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e623cb-7085-4eb2-8eee-4140d710ad63 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.023938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.024656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.024924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.025207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.026090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:41.026506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.028230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.046647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 600/1192] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:41.058714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.071282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9b917-7fde-4571-a8a7-6b953f55dc9b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.078767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.079802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.080089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.080385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.091466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.093959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.112335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 15:44:41.113869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 593/1193] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/users/placement => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:41.121168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.135434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc443b5-33c6-4ae7-b20e-aff729583bc3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.140816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.141590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.141938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.142368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.143403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:41.143722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.145723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.170042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 601/1194] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:41.176902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.190676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c6f49-9c7b-45e2-b360-4c861481bb70 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.196541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.197233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.197532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.197808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.207090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.208957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.223194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 594/1195] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:44:41.231003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.243041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bf9f9-8c63-4c24-bd94-9893b976687f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.251188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.252737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.253238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.253742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.277760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.281594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.306516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:41.307955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 602/1196] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:41.319198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.329890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977d9af-0586-460d-9b08-b670c9d0330b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.337372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.338053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.338367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.338636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.339390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:41.339694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.341387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.357305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 595/1197] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:41.364628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.382984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3bff6-c859-448d-92eb-63111c3643de admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.391722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.393175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.393677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.394192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.408338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.412331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.429526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:44:41.431964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 603/1198] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:41.441431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.453267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc690fb-5197-4efe-b78b-5ba4fa9cf464 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.462673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.463867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.464374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.464860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.465814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:41.466335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.468097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbdfa5-3dc0-4c1a-90b3-1630e6a692d6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.490297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 596/1199] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:41.500587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:41.511967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43517f-535e-4113-82bf-206c3a771c22 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:41.518540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:41.519320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:41.519591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:41.519879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:41.520893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=e88500f303d44f67a828798654c72b46) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:41.521276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:41.523375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24201ce7-c2fd-41dd-9eb6-16c900766a2e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:41.530451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 604/1200] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:44:41 2021] GET /identity/v3/role_assignments?user.id=e88500f303d44f67a828798654c72b46&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:44.144278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a3392-391a-44ec-8a0d-fc8410e88e7e None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.144278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a3392-391a-44ec-8a0d-fc8410e88e7e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.144278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a3392-391a-44ec-8a0d-fc8410e88e7e None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.145908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 597/1201] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:44 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:44.154219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.155239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.155239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.174468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:44.175838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:44.185283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 605/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:44.209840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a3392-391a-44ec-8a0d-fc8410e88e7e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.227385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a3392-391a-44ec-8a0d-fc8410e88e7e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.232279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.233024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.233377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.233694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.250986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:44:44.265121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:44:44.268070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 598/1203] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:44.276913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.292487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff875f2-eb72-4f0e-b709-649bc36242be None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.307247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.311808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.311808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.311808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.311808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:44.311808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.311808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.322750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 606/1204] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:44:44.329992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.344393 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213401a-8d06-49f4-9ff3-44ca9f10dd3f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.350932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.351877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.352170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.352429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.369333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.371675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.392633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:44.394214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 599/1205] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:44.402476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.415372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55169e1f-f0b9-40d4-a4c1-ab70697ea929 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.422219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.422906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.423262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.423473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.424260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:44.424574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.426654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.441775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 607/1206] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:44.450034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.462038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e38ef-f329-4bca-9593-4bf800046a50 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.468227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.469062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.469335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.469624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.481314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.483690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.502073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 15:44:44.503799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 600/1207] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:44.511109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.522615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02226d-0aa2-4417-aac6-abc06eb6e174 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.528992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.529630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.529914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.530228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.531123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:44.531427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.535418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.554128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 608/1208] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:44:44.560811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.572617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7654b-6b98-4618-beb2-9679172737f2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.577760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.578659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.578943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.579223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.592064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.593980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.614696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:44.621864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 601/1209] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 10 15:44:44.623533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.639080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807123-4c9d-4a99-bc70-71d7645cc49b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.646641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.647633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.648043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.648526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.649572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:44.650112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.652050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.673786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 609/1210] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:44.675227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.688165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141af275-f419-49a5-9e78-b28ed0d353cf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.695110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.696171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.696524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.696885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.706397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.708765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.725041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:44:44.726675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 602/1211] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:44.737870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.761897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcd8c2-55eb-4720-bffb-875382f1d620 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.770683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.771924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.772519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.773455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.775664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:44.776335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.780765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d28b-1624-42b1-962a-eae50131905a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.800267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 610/1212] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:44:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:44.808696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:44.825858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6ac9b-c818-4702-a2fa-4f5999f96995 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:44.832805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f000fe-82fa-4c64-8362-b2e8feac28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:44.834116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f000fe-82fa-4c64-8362-b2e8feac28aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:44.834610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f000fe-82fa-4c64-8362-b2e8feac28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:44.835045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f000fe-82fa-4c64-8362-b2e8feac28aa admin admin] PATH_INFO: `/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/e88500f303d44f67a828798654c72b46/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:44.837791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f000fe-82fa-4c64-8362-b2e8feac28aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f1ad84c65c41b38b6e138a457d1adc, user_id=e88500f303d44f67a828798654c72b46, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:44.842033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f000fe-82fa-4c64-8362-b2e8feac28aa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:44.859574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 603/1213] 10.222.0.60 () {58 vars in 1460 bytes} [Wed Nov 10 15:44:44 2021] PUT /identity/v3/projects/06f1ad84c65c41b38b6e138a457d1adc/users/e88500f303d44f67a828798654c72b46/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:44:47.456696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0841b-deec-4b74-af4a-1503a14a24ef None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.457261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0841b-deec-4b74-af4a-1503a14a24ef None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.457507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0841b-deec-4b74-af4a-1503a14a24ef None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.459774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 611/1214] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:44:47.467475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034824-9c06-43dd-a673-644822a508b3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.468260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034824-9c06-43dd-a673-644822a508b3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.468260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05034824-9c06-43dd-a673-644822a508b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.489220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-05034824-9c06-43dd-a673-644822a508b3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:47.490810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-05034824-9c06-43dd-a673-644822a508b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:47.590632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 604/1215] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:47.630851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0841b-deec-4b74-af4a-1503a14a24ef None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.650677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0841b-deec-4b74-af4a-1503a14a24ef None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.657604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.658467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.658834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.659292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.673690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 10 15:44:47.681466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 10 15:44:47.682984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 612/1216] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:47.692269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034824-9c06-43dd-a673-644822a508b3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.704257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05034824-9c06-43dd-a673-644822a508b3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.710356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.711143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.711418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.711686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.712491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:47.712792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:47.714508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:47.724759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 605/1217] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:47.731787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.743838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2959-0101-41e8-925f-0651e19e50c2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.749357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.750237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.750507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.750793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.763942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:47.765879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:47.789055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:47.791376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 613/1218] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:47.800259 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.817308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b33b-08ea-4ca5-a19a-6c3484c4e006 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.825200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.826189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.826616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.827062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.828232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:47.828829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:47.832129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:47.852791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 606/1219] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:47.860411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.871588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d4177-8891-49f2-9349-f722a12f1fb6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.877946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.878841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.879117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.879390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.889107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:47.891258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:47.908594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 10 15:44:47.909927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 614/1220] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:47.921735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.939153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891ede-9278-4452-b843-c51182e086b2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.944229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.944951 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.945229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.945620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:47.946781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:47.947098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:47.949099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:47.970313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 607/1221] 10.222.0.60 () {56 vars in 1164 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:47.977737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:47.988870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf115c-7481-4763-a4c7-440fcbb06622 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:47.994829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:47.995480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:47.995731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:47.995991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:48.005882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:48.008019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:48.018547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 615/1222] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Nov 10 15:44:47 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:44:48.025822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:48.037994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dface44-d29a-46d2-a6ab-ac9bb2d4955b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:48.044944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:48.045749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:48.046351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:48.046483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:48.061587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:48.061587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:48.079235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 10 15:44:48.080850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 608/1223] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Nov 10 15:44:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:48.087611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:48.098294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174938-dbfd-4e4f-b4f4-ccdc756415a0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:48.103255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:48.103858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:48.104133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:48.104413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:48.105172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:48.105469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:48.107141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:48.120206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 616/1224] 10.222.0.60 () {56 vars in 1130 bytes} [Wed Nov 10 15:44:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:44:48.131931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:48.143560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f2b4b-b6cb-4b4b-b4b1-e91087c7f024 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:48.148783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:48.149637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:48.149950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:48.150261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:48.158644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:48.160661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:48.175624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING keystone.server.flask.application [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 10 15:44:48.177093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 609/1225] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Nov 10 15:44:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:48.184462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:48.197652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55132e92-eaab-424a-802c-520f83528290 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:48.205208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:48.205882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:48.206229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:48.206590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:48.207717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:48.208321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:48.210290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542235a7-bfec-4998-a486-7abb51da8141 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:48.223871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 617/1226] 10.222.0.60 () {56 vars in 1169 bytes} [Wed Nov 10 15:44:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:48.231599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:48.243353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d320f2-c5b7-4b92-899b-23d948304a63 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:48.249412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:48.250417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:48.250795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:48.251254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:48.252224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] RBAC: Adding query filter params (role.id=5e9f996724a24bb3aa705c50863a0224, scope.project.id=06f1ad84c65c41b38b6e138a457d1adc, user.id=e88500f303d44f67a828798654c72b46) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:48.252531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:48.254454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8f3b3-222d-429b-96db-670ae9a815ac admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:48.261350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 610/1227] 10.222.0.60 () {56 vars in 1395 bytes} [Wed Nov 10 15:44:48 2021] GET /identity/v3/role_assignments?user.id=e88500f303d44f67a828798654c72b46&scope.project.id=06f1ad84c65c41b38b6e138a457d1adc&role.id=5e9f996724a24bb3aa705c50863a0224 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:50.783720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292873-9999-44cb-999a-b99402265bf9 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:50.784278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292873-9999-44cb-999a-b99402265bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:50.784368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292873-9999-44cb-999a-b99402265bf9 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:50.786677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 618/1228] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:50.800483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:50.801092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:50.801688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:50.830696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:50.832263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:50.843399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 611/1229] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:50.872984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36292873-9999-44cb-999a-b99402265bf9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:50.888558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36292873-9999-44cb-999a-b99402265bf9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:50.893982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:50.894859 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:50.895133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:50.895402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:50.896105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:50.897790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:50.911315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 10 15:44:50.912624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 619/1230] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:44:50 2021] GET /identity/v3/services/placement => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:50.922444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:50.933561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8f38-def4-40b6-9293-4f79c5cac6ac None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:50.938862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:50.939542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:50.939820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:50.940094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:50.940840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:50.941148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:50.942832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c445ef-98b3-427b-814f-91ea12e53cee admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:50.949573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 612/1231] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Nov 10 15:44:50 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:50.956640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:50.967738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa59014-51c3-4511-9758-6747425fc8bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:50.972673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:50.973362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:50.973635 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:50.973927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] PATH_INFO: `/v3/services` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:50.974744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:50.975042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:50.976754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b212a2-7331-45b8-850e-b8d5386e1034 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:50.982420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 620/1232] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Nov 10 15:44:50 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:53.331678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f60e39-5e00-45cf-a16f-99808fb13be6 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:53.332305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f60e39-5e00-45cf-a16f-99808fb13be6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:53.332305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f60e39-5e00-45cf-a16f-99808fb13be6 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:53.334045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 613/1233] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:53.340607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b9b73-ba10-4ad1-a6e3-2731fbee4920 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:53.341117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b9b73-ba10-4ad1-a6e3-2731fbee4920 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:53.341117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b9b73-ba10-4ad1-a6e3-2731fbee4920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:53.360916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2a4b9b73-ba10-4ad1-a6e3-2731fbee4920 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:53.362152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2a4b9b73-ba10-4ad1-a6e3-2731fbee4920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:53.371669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 621/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:53.397718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f60e39-5e00-45cf-a16f-99808fb13be6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:53.411963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f60e39-5e00-45cf-a16f-99808fb13be6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:53.417681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61255-7a8b-401c-8db5-3d3f893a8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:53.418764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61255-7a8b-401c-8db5-3d3f893a8387 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:53.419047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61255-7a8b-401c-8db5-3d3f893a8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:53.419322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61255-7a8b-401c-8db5-3d3f893a8387 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:53.420065 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c61255-7a8b-401c-8db5-3d3f893a8387 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:53.421703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c61255-7a8b-401c-8db5-3d3f893a8387 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:53.437688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 614/1235] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Nov 10 15:44:53 2021] POST /identity/v3/services => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:44:55.878067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6c48f-adf0-47f5-9adf-40250c860cee None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:55.878800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6c48f-adf0-47f5-9adf-40250c860cee None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:55.879117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6c48f-adf0-47f5-9adf-40250c860cee None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:55.882405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 622/1236] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:55 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:55.890560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:55.891290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:55.891290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:55.911009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:55.912467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:55.933445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 615/1237] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:55 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:55.959584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6c48f-adf0-47f5-9adf-40250c860cee None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:55.973087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6c48f-adf0-47f5-9adf-40250c860cee None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:55.977999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:55.978867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:55.979155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:55.979434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:55.980121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:55.981777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:55.993455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 10 15:44:55.994707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 623/1238] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:44:55 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:56.001852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:56.011617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57b36-70c6-4355-8cc0-33ad1bafc9f6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:56.016685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:56.017367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:56.017647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:56.017925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:56.018739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:56.019049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:56.021038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:56.029329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 616/1239] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Nov 10 15:44:56 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:56.036423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:56.047614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6e284-582b-4022-bb0b-c779cffea75a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:56.053024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:56.053677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:56.053981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:56.054375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:56.055388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] RBAC: Adding query filter params (interface=public, service_id=683f51924d87491e9b97cd1b14cf594d, region_id=RegionOne) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:56.055714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:56.057340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463488b-e66f-4eb1-a1c8-6392e8a364b6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:56.063245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 624/1240] 10.222.0.60 () {56 vars in 1272 bytes} [Wed Nov 10 15:44:56 2021] GET /identity/v3/endpoints?service_id=683f51924d87491e9b97cd1b14cf594d&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:56.070054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:56.080610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358420f3-dcc7-44b8-80c8-84e8c1830487 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:56.086060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b97077-c163-454c-81b9-4f6e7dacdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:56.086756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97077-c163-454c-81b9-4f6e7dacdcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:56.087044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97077-c163-454c-81b9-4f6e7dacdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:56.088574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b97077-c163-454c-81b9-4f6e7dacdcc0 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:56.088574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97077-c163-454c-81b9-4f6e7dacdcc0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:56.090248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b97077-c163-454c-81b9-4f6e7dacdcc0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:56.096985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 617/1241] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:44:56 2021] GET /identity/v3/services => generated 2191 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:44:58.521808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c06478-1cac-4e18-ba8e-cfae61645460 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:58.522694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c06478-1cac-4e18-ba8e-cfae61645460 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:58.522694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c06478-1cac-4e18-ba8e-cfae61645460 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:58.524562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 625/1242] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:44:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:44:58.531107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:58.531664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:58.531664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:58.557893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:44:58.560104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:44:58.573944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 618/1243] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:44:58 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:44:58.604235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c06478-1cac-4e18-ba8e-cfae61645460 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:58.617975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c06478-1cac-4e18-ba8e-cfae61645460 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:58.623057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:58.623881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:58.624156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:58.624424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:58.625117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:58.626793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:58.638666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 10 15:44:58.640096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 626/1244] 10.222.0.60 () {56 vars in 1138 bytes} [Wed Nov 10 15:44:58 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 10 15:44:58.647404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:58.657205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084d8a-70e3-4e85-bb12-d7683cccf8ee None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:58.663261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:58.663951 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:58.664339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:58.664620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] PATH_INFO: `/v3/services` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:58.665339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:44:58.665647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:58.667408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa86bc-84d6-4769-b083-6a60112d0126 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:58.674633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 619/1245] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Nov 10 15:44:58 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:44:58.681817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:44:58.693192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce8e9e-ce38-46c2-a7cf-35ff5b98edbb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:44:58.699367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64193ecd-bea0-4a6c-a970-432c2edf4cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:44:58.700031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193ecd-bea0-4a6c-a970-432c2edf4cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:44:58.700315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193ecd-bea0-4a6c-a970-432c2edf4cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:44:58.700585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64193ecd-bea0-4a6c-a970-432c2edf4cf1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:44:58.701348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64193ecd-bea0-4a6c-a970-432c2edf4cf1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:44:58.703050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64193ecd-bea0-4a6c-a970-432c2edf4cf1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:44:58.723975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 627/1246] 10.222.0.60 () {60 vars in 1165 bytes} [Wed Nov 10 15:44:58 2021] POST /identity/v3/endpoints => generated 331 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:46:07.419795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131771d-c216-42e5-8483-fe36f12c6780 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:07.420317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131771d-c216-42e5-8483-fe36f12c6780 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:07.420317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131771d-c216-42e5-8483-fe36f12c6780 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:07.422142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 620/1247] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:07.431809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d07432-ad39-4d08-a51d-74774ab666f7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:07.432607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d07432-ad39-4d08-a51d-74774ab666f7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:07.433037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d07432-ad39-4d08-a51d-74774ab666f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:07.638989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c9d07432-ad39-4d08-a51d-74774ab666f7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:07.640211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c9d07432-ad39-4d08-a51d-74774ab666f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:07.798480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:07.825760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131771d-c216-42e5-8483-fe36f12c6780 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:07.827957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0131771d-c216-42e5-8483-fe36f12c6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:08.011061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131771d-c216-42e5-8483-fe36f12c6780 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:08.142212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732a770-2134-4570-9521-4122700f9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:08.143288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732a770-2134-4570-9521-4122700f9ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:08.143625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732a770-2134-4570-9521-4122700f9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:08.143934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732a770-2134-4570-9521-4122700f9ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:08.145598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732a770-2134-4570-9521-4122700f9ac1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:08.148183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732a770-2134-4570-9521-4122700f9ac1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:08.176812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 621/1249] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:46:07 2021] GET /identity/v3/projects => generated 2553 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:46:10.639419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7fa6-b0a3-43dd-8f11-6a4b13112dab None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:10.640008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7fa6-b0a3-43dd-8f11-6a4b13112dab None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:10.640008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7fa6-b0a3-43dd-8f11-6a4b13112dab None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:10.641814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 629/1250] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:10.648553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d14c-126a-473a-9086-1bcb415a5bb9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:10.649234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d14c-126a-473a-9086-1bcb415a5bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:10.649234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d14c-126a-473a-9086-1bcb415a5bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:10.730827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-60f9d14c-126a-473a-9086-1bcb415a5bb9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:10.732039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-60f9d14c-126a-473a-9086-1bcb415a5bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:10.842891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 622/1251] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:10.895623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e25a1-3691-4a4c-835f-47a8c219de3f None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:10.895820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e25a1-3691-4a4c-835f-47a8c219de3f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:10.896092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e25a1-3691-4a4c-835f-47a8c219de3f None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:10.898293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 630/1252] 10.222.0.60 () {54 vars in 964 bytes} [Wed Nov 10 15:46:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:10.904273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfdedd-e9b1-4e19-883e-5a358c12ea83 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:10.904646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfdedd-e9b1-4e19-883e-5a358c12ea83 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:10.904993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfdedd-e9b1-4e19-883e-5a358c12ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:10.986512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3acfdedd-e9b1-4e19-883e-5a358c12ea83 None None] MFA Rules not processed for user `2ecc2dca57d045869f1fcf3a4337b990`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:10.987783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3acfdedd-e9b1-4e19-883e-5a358c12ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:11.066436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 623/1253] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Nov 10 15:46:10 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:11.076486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e25a1-3691-4a4c-835f-47a8c219de3f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:11.078043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a20e25a1-3691-4a4c-835f-47a8c219de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:11.191194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e25a1-3691-4a4c-835f-47a8c219de3f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:11.267543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:11.268307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:11.268660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:11.269011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:11.271034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:11.396254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:11.397734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eb48e-e2c5-489a-9ee8-8efbc8b913b5 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:11.417750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 631/1254] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:13.968336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feab287-1def-4215-8e32-3ac692e4b02c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:13.968870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feab287-1def-4215-8e32-3ac692e4b02c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:13.968870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feab287-1def-4215-8e32-3ac692e4b02c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:13.970658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 624/1255] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:13.977104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4fb44-c363-40f9-8bd8-4901e5b92f97 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:13.977616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4fb44-c363-40f9-8bd8-4901e5b92f97 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:13.977616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4fb44-c363-40f9-8bd8-4901e5b92f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:14.051380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6cb4fb44-c363-40f9-8bd8-4901e5b92f97 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:14.052637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6cb4fb44-c363-40f9-8bd8-4901e5b92f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:14.160182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 632/1256] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:14.204853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feab287-1def-4215-8e32-3ac692e4b02c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:14.207450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4feab287-1def-4215-8e32-3ac692e4b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:14.326456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feab287-1def-4215-8e32-3ac692e4b02c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:14.404094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:14.404752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:14.405020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:14.405293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:14.406984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:14.525787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:14.527175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaffd6-48ea-471c-917c-51665ba9d96e service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:14.547293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 625/1257] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:17.209857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb3d8-1dc7-469e-ae94-c825253fac3d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:17.210507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb3d8-1dc7-469e-ae94-c825253fac3d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:17.210507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb3d8-1dc7-469e-ae94-c825253fac3d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:17.212271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 633/1258] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:17.218661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:17.219205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:17.219205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:17.287003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:17.288333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:17.389098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 626/1259] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:17.427608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deb3d8-1dc7-469e-ae94-c825253fac3d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:17.429133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d5deb3d8-1dc7-469e-ae94-c825253fac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:17.552682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deb3d8-1dc7-469e-ae94-c825253fac3d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:17.653244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4a4e0-b34e-4d86-b1c3-cfbc4824f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:17.654192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a4e0-b34e-4d86-b1c3-cfbc4824f2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:17.654475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a4e0-b34e-4d86-b1c3-cfbc4824f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:17.654749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a4e0-b34e-4d86-b1c3-cfbc4824f2e5 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:17.666471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4a4e0-b34e-4d86-b1c3-cfbc4824f2e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:17.668600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4a4e0-b34e-4d86-b1c3-cfbc4824f2e5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:17.670479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 634/1260] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:46:17 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:46:17.688145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:17.690058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:17.794048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6170a4e-ab45-4905-9d3f-2d8171aa8c81 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:17.874340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:17.874894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:17.875175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:17.875473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:17.877170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:17.993018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:17.994524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1ab95-7ec4-43ea-b5c1-1eec8c7c1215 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:18.019671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 627/1261] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:20.886699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc88c-adcf-4807-af6e-3fcc5d0220e9 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:20.887282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc88c-adcf-4807-af6e-3fcc5d0220e9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:20.887282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc88c-adcf-4807-af6e-3fcc5d0220e9 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:20.889080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 635/1262] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:20.895817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:20.896317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:20.896317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:20.966085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:20.967367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:21.069299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 628/1263] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:21.105989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc88c-adcf-4807-af6e-3fcc5d0220e9 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:21.107621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1b8dc88c-adcf-4807-af6e-3fcc5d0220e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:21.239363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc88c-adcf-4807-af6e-3fcc5d0220e9 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:21.341506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec692bb6-ec73-4ec2-8561-4ea08cc68939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:21.342425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec692bb6-ec73-4ec2-8561-4ea08cc68939 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:21.342713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec692bb6-ec73-4ec2-8561-4ea08cc68939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:21.342984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec692bb6-ec73-4ec2-8561-4ea08cc68939 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:21.354019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec692bb6-ec73-4ec2-8561-4ea08cc68939 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:21.356145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec692bb6-ec73-4ec2-8561-4ea08cc68939 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:21.357932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 636/1264] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:46:21 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:46:21.371067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:21.372312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:21.469171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da939d-d19c-4abc-961d-6d3592e08f96 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:21.545134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:21.545688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:21.545969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:21.546273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:21.547941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:21.654969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:21.656428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc2fb-bc8f-4386-986c-29f6d856c067 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:21.675185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 629/1265] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:24.758751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4e76-c9ab-4559-bb4d-57aa2f9e2525 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:24.759320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4e76-c9ab-4559-bb4d-57aa2f9e2525 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:24.759320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4e76-c9ab-4559-bb4d-57aa2f9e2525 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:24.761157 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 637/1266] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:24.768224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb95e8-6d77-44a2-a9b9-76b9eb3681c2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:24.768822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb95e8-6d77-44a2-a9b9-76b9eb3681c2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:24.768822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb95e8-6d77-44a2-a9b9-76b9eb3681c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:24.861259 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-21fb95e8-6d77-44a2-a9b9-76b9eb3681c2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:24.862585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-21fb95e8-6d77-44a2-a9b9-76b9eb3681c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:24.964121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 630/1267] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:25.003745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4e76-c9ab-4559-bb4d-57aa2f9e2525 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:25.005727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-891b4e76-c9ab-4559-bb4d-57aa2f9e2525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:25.111921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4e76-c9ab-4559-bb4d-57aa2f9e2525 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:25.190734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:25.191389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:25.191874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:25.192147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:25.194054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:25.310353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:25.311797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd629cf-8c93-445d-a8ec-c2f201601bb1 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:25.330804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 638/1268] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:27.699121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec2ac0-8a4b-4cb2-990b-23f450590c36 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:27.699680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec2ac0-8a4b-4cb2-990b-23f450590c36 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:27.699680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec2ac0-8a4b-4cb2-990b-23f450590c36 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:27.701501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 631/1269] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:27.708121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c42dc1-d816-46f2-aa7a-c8dfe5d78f05 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:27.708597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c42dc1-d816-46f2-aa7a-c8dfe5d78f05 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:27.708713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c42dc1-d816-46f2-aa7a-c8dfe5d78f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:27.778768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-51c42dc1-d816-46f2-aa7a-c8dfe5d78f05 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:27.779984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-51c42dc1-d816-46f2-aa7a-c8dfe5d78f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:27.886534 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 639/1270] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:27.928391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec2ac0-8a4b-4cb2-990b-23f450590c36 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:27.929939 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3dec2ac0-8a4b-4cb2-990b-23f450590c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:28.036301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec2ac0-8a4b-4cb2-990b-23f450590c36 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:28.117244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:28.117904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:28.118187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:28.118491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:28.120154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:28.238625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:28.240155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfab3e-fb2d-45c0-a383-290c9f8cf37e service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:28.259748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 632/1271] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:30.603979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2406df-a59a-44d0-a96c-41129deaa2b7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:30.604614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2406df-a59a-44d0-a96c-41129deaa2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:30.604614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2406df-a59a-44d0-a96c-41129deaa2b7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:30.606318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 640/1272] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:30.613168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:30.613933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:30.613933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:30.691802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:30.693180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:30.814903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 633/1273] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:30.850763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2406df-a59a-44d0-a96c-41129deaa2b7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:30.852309 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ec2406df-a59a-44d0-a96c-41129deaa2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:30.999198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2406df-a59a-44d0-a96c-41129deaa2b7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:31.108090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371119f1-9fca-4115-88cb-4cb95169a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:31.108883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371119f1-9fca-4115-88cb-4cb95169a1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:31.109194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371119f1-9fca-4115-88cb-4cb95169a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:31.109570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371119f1-9fca-4115-88cb-4cb95169a1d5 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:31.121606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371119f1-9fca-4115-88cb-4cb95169a1d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:31.123969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371119f1-9fca-4115-88cb-4cb95169a1d5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:31.125902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 641/1274] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:46:30 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:46:31.139207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:31.140546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:31.241758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a63920-ae26-4b1c-8107-3de408416c2a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:31.328350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:31.329083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:31.329349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:31.329622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:31.331545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:31.451482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:31.453021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c0dab-2faf-475e-9f6b-ab7d75f69bcf service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:31.474580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 634/1275] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:34.086644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9caa-934f-425e-b33e-1aff748d4fe6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:34.087240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9caa-934f-425e-b33e-1aff748d4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:34.087240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9caa-934f-425e-b33e-1aff748d4fe6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:34.089003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 642/1276] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:34.095555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1535b-4c8a-4da3-8c62-4d3373d42472 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:34.096103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1535b-4c8a-4da3-8c62-4d3373d42472 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:34.096103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1535b-4c8a-4da3-8c62-4d3373d42472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:34.171667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-31d1535b-4c8a-4da3-8c62-4d3373d42472 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:34.172905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-31d1535b-4c8a-4da3-8c62-4d3373d42472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:34.273670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 635/1277] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:34.313010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d9caa-934f-425e-b33e-1aff748d4fe6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:34.314627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-544d9caa-934f-425e-b33e-1aff748d4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:34.424659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d9caa-934f-425e-b33e-1aff748d4fe6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:34.498339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:34.498989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:34.499262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:34.499531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:34.501216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:34.609580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:34.611113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa44260-7745-4526-8a27-0eb26813dcd4 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:34.629436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 643/1278] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:36.931339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57060869-2d12-4e44-9352-a29ee2351583 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:36.931907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57060869-2d12-4e44-9352-a29ee2351583 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:36.931907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57060869-2d12-4e44-9352-a29ee2351583 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:36.933672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 636/1279] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:36.940083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbac6af-5fc3-4661-a718-6d9d2f027495 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:36.940539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbac6af-5fc3-4661-a718-6d9d2f027495 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:36.940627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbac6af-5fc3-4661-a718-6d9d2f027495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:37.014968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3cbac6af-5fc3-4661-a718-6d9d2f027495 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:37.016188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cbac6af-5fc3-4661-a718-6d9d2f027495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:37.116464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 644/1280] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:37.161556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57060869-2d12-4e44-9352-a29ee2351583 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:37.163173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-57060869-2d12-4e44-9352-a29ee2351583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:37.271479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57060869-2d12-4e44-9352-a29ee2351583 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:37.348415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:37.349073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:37.349374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:37.349653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:37.351348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:37.466068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:37.467566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebcd6c-1182-4050-a91b-21644fdb4e58 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:37.486310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 637/1281] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:40.225317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e3b0-1a5b-4a0f-bed7-58a82959c541 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:40.225875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e3b0-1a5b-4a0f-bed7-58a82959c541 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:40.225875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4e3b0-1a5b-4a0f-bed7-58a82959c541 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:40.227696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 645/1282] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:40.234185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209f9b-4a83-4308-9c72-c95556ca77ef None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:40.234651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209f9b-4a83-4308-9c72-c95556ca77ef None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:40.234762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209f9b-4a83-4308-9c72-c95556ca77ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:40.318737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0d209f9b-4a83-4308-9c72-c95556ca77ef None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:40.320002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0d209f9b-4a83-4308-9c72-c95556ca77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:40.428789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 638/1283] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:40.467271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4e3b0-1a5b-4a0f-bed7-58a82959c541 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:40.470140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-81c4e3b0-1a5b-4a0f-bed7-58a82959c541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:40.566954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4e3b0-1a5b-4a0f-bed7-58a82959c541 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:40.571701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9486a-77e3-4cca-874b-fe385b9fee18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:40.572462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9486a-77e3-4cca-874b-fe385b9fee18 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:40.572622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9486a-77e3-4cca-874b-fe385b9fee18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:40.572882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9486a-77e3-4cca-874b-fe385b9fee18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:40.583639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9486a-77e3-4cca-874b-fe385b9fee18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:40.585083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9486a-77e3-4cca-874b-fe385b9fee18 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:40.595098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 646/1284] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:45.096578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b79e-3e29-472d-b719-fd7c8132995c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:45.097128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b79e-3e29-472d-b719-fd7c8132995c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:45.097128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75b79e-3e29-472d-b719-fd7c8132995c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:45.099182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 639/1285] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:45.106220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ea6c-495c-4476-893f-8596857ff19b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:45.107076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ea6c-495c-4476-893f-8596857ff19b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:45.107268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ea6c-495c-4476-893f-8596857ff19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:45.126704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5822ea6c-495c-4476-893f-8596857ff19b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:45.128190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5822ea6c-495c-4476-893f-8596857ff19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:45.137540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 647/1286] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:45.229130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d1276-4814-4dd9-9498-638009f2f6b9 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:45.229807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d1276-4814-4dd9-9498-638009f2f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:45.230236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d1276-4814-4dd9-9498-638009f2f6b9 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:45.232550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 640/1287] 10.222.0.60 () {54 vars in 964 bytes} [Wed Nov 10 15:46:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:45.249249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053867-e13f-4fda-8cf3-19280fbc167a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:45.250888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053867-e13f-4fda-8cf3-19280fbc167a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:45.252024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053867-e13f-4fda-8cf3-19280fbc167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:45.345287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-04053867-e13f-4fda-8cf3-19280fbc167a None None] MFA Rules not processed for user `2ecc2dca57d045869f1fcf3a4337b990`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:45.346693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-04053867-e13f-4fda-8cf3-19280fbc167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:45.354897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 648/1288] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Nov 10 15:46:45 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:45.365052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d1276-4814-4dd9-9498-638009f2f6b9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:45.379447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d1276-4814-4dd9-9498-638009f2f6b9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:45.384374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6c037-5d84-4d7e-99e1-ce7c1ff75543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:45.385214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c037-5d84-4d7e-99e1-ce7c1ff75543 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:45.385583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c037-5d84-4d7e-99e1-ce7c1ff75543 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:45.385923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c037-5d84-4d7e-99e1-ce7c1ff75543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:45.410863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6c037-5d84-4d7e-99e1-ce7c1ff75543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:45.412584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6c037-5d84-4d7e-99e1-ce7c1ff75543 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:45.431089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 641/1289] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:49.123579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e43e-ae66-48ed-b448-09005ce283a3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:49.124245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e43e-ae66-48ed-b448-09005ce283a3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:49.124245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e43e-ae66-48ed-b448-09005ce283a3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:49.125846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 649/1290] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:49.132803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ce7f-c907-41c1-805e-8588f4b5b944 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:49.133301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ce7f-c907-41c1-805e-8588f4b5b944 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:49.133393 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ce7f-c907-41c1-805e-8588f4b5b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:49.152627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-54d8ce7f-c907-41c1-805e-8588f4b5b944 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:49.153817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-54d8ce7f-c907-41c1-805e-8588f4b5b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:49.162856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 642/1291] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:49.204861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e43e-ae66-48ed-b448-09005ce283a3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:49.218087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e43e-ae66-48ed-b448-09005ce283a3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:49.222456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20339da-70ba-4c70-b62a-de0be03ad13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:49.223264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20339da-70ba-4c70-b62a-de0be03ad13f service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:49.223613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20339da-70ba-4c70-b62a-de0be03ad13f service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:49.223887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20339da-70ba-4c70-b62a-de0be03ad13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:49.234122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20339da-70ba-4c70-b62a-de0be03ad13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:49.235617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20339da-70ba-4c70-b62a-de0be03ad13f service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:49.246731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 650/1292] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:53.950766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc381d-3b6c-4fb5-a995-9442d890cdd3 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:53.951302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc381d-3b6c-4fb5-a995-9442d890cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:53.951302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc381d-3b6c-4fb5-a995-9442d890cdd3 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:53.953227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 643/1293] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:46:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:53.959940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0fd8-4a1b-4a43-b88b-39c746b5df63 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:53.960459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0fd8-4a1b-4a43-b88b-39c746b5df63 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:53.960459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0fd8-4a1b-4a43-b88b-39c746b5df63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:53.981481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b6fa0fd8-4a1b-4a43-b88b-39c746b5df63 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:53.982745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b6fa0fd8-4a1b-4a43-b88b-39c746b5df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:53.991137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 651/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:46:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:46:54.034510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc381d-3b6c-4fb5-a995-9442d890cdd3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:46:54.046872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc381d-3b6c-4fb5-a995-9442d890cdd3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:46:54.050909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344106-e30a-445a-879c-93c431c1ca8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:46:54.051840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344106-e30a-445a-879c-93c431c1ca8e service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:54.052136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344106-e30a-445a-879c-93c431c1ca8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:54.052422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344106-e30a-445a-879c-93c431c1ca8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:54.063201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344106-e30a-445a-879c-93c431c1ca8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:46:54.065057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344106-e30a-445a-879c-93c431c1ca8e service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:46:54.076565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 644/1295] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:46:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:46:59.491808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf9d4b-9738-44a5-8285-b50c77eaf8b3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:59.492455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf9d4b-9738-44a5-8285-b50c77eaf8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:59.492688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf9d4b-9738-44a5-8285-b50c77eaf8b3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:59.495846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 652/1296] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:46:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:46:59.505469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820ef0e-cb1c-4dac-a4a5-90c29bb31314 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:46:59.506267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820ef0e-cb1c-4dac-a4a5-90c29bb31314 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:46:59.506267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820ef0e-cb1c-4dac-a4a5-90c29bb31314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:46:59.592100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8820ef0e-cb1c-4dac-a4a5-90c29bb31314 None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:46:59.593738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8820ef0e-cb1c-4dac-a4a5-90c29bb31314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:46:59.760275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 645/1297] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:46:59 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:05.358924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491c7a-19dc-4610-8a22-9922ecf1538c None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:05.359508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491c7a-19dc-4610-8a22-9922ecf1538c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:05.359766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491c7a-19dc-4610-8a22-9922ecf1538c None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:05.361620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 653/1298] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:47:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:05.368283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c4ad-a7fc-4e95-9d8f-3b568b903abf None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:05.368886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c4ad-a7fc-4e95-9d8f-3b568b903abf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:05.368886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c4ad-a7fc-4e95-9d8f-3b568b903abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:05.391041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bdb2c4ad-a7fc-4e95-9d8f-3b568b903abf None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:05.392331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bdb2c4ad-a7fc-4e95-9d8f-3b568b903abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:05.404396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 646/1299] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:47:05 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:06.889913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77840e-603e-4dfb-bf23-e51d0668c061 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:06.890522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77840e-603e-4dfb-bf23-e51d0668c061 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:06.890522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77840e-603e-4dfb-bf23-e51d0668c061 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:06.892233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 654/1300] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:47:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:06.898362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272bc0e-46df-4b5a-b5b7-bc9c8046c72b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:06.899686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272bc0e-46df-4b5a-b5b7-bc9c8046c72b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:06.899686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272bc0e-46df-4b5a-b5b7-bc9c8046c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:06.919049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1272bc0e-46df-4b5a-b5b7-bc9c8046c72b None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:06.920400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1272bc0e-46df-4b5a-b5b7-bc9c8046c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:06.930287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 647/1301] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:47:06 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:47:11.646311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeb7bc-b7be-4664-96a1-b3534551702d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:11.646877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeb7bc-b7be-4664-96a1-b3534551702d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:11.646877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeb7bc-b7be-4664-96a1-b3534551702d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:11.649134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 655/1302] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:11.655535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51aa37-367d-4100-8164-898d240e5243 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:11.656053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51aa37-367d-4100-8164-898d240e5243 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:11.656053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51aa37-367d-4100-8164-898d240e5243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:11.679913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-eb51aa37-367d-4100-8164-898d240e5243 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:11.681421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-eb51aa37-367d-4100-8164-898d240e5243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:11.690875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 648/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:11.746770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921a5b6-e07c-4e88-ab21-4e2d5f1a1ecb None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:11.747126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921a5b6-e07c-4e88-ab21-4e2d5f1a1ecb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:11.747424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921a5b6-e07c-4e88-ab21-4e2d5f1a1ecb None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:11.749182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 656/1304] 10.222.0.60 () {54 vars in 960 bytes} [Wed Nov 10 15:47:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:11.755752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a393fb-e906-4cad-b747-f9fd502cde9c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:11.756290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a393fb-e906-4cad-b747-f9fd502cde9c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:11.756701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a393fb-e906-4cad-b747-f9fd502cde9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:11.825879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b6a393fb-e906-4cad-b747-f9fd502cde9c None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:11.827457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b6a393fb-e906-4cad-b747-f9fd502cde9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:11.964228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 649/1305] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Nov 10 15:47:11 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:11.984988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921a5b6-e07c-4e88-ab21-4e2d5f1a1ecb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:12.001602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921a5b6-e07c-4e88-ab21-4e2d5f1a1ecb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:12.007660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f9294-e809-4797-b3f0-5fb867fe798d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:12.008560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f9294-e809-4797-b3f0-5fb867fe798d service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:12.009000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f9294-e809-4797-b3f0-5fb867fe798d service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:12.009460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f9294-e809-4797-b3f0-5fb867fe798d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:12.021145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f9294-e809-4797-b3f0-5fb867fe798d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:12.023165 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f9294-e809-4797-b3f0-5fb867fe798d service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:12.035507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 657/1306] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:14.687093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bcee-1b7b-4675-b27a-e46d9560958a None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:14.687947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bcee-1b7b-4675-b27a-e46d9560958a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:14.687947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bcee-1b7b-4675-b27a-e46d9560958a None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:14.689810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 650/1307] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:47:14.695924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c209c-0dfc-4098-b1b0-90bc78192ae5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:14.696387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c209c-0dfc-4098-b1b0-90bc78192ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:14.696488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c209c-0dfc-4098-b1b0-90bc78192ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:14.715220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7c6c209c-0dfc-4098-b1b0-90bc78192ae5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:14.716509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7c6c209c-0dfc-4098-b1b0-90bc78192ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:14.725481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 658/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:14.776710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417bcee-1b7b-4675-b27a-e46d9560958a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:14.810220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417bcee-1b7b-4675-b27a-e46d9560958a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:14.818221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b73eb-9195-4515-b3b6-a834d31ba440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:14.819451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b73eb-9195-4515-b3b6-a834d31ba440 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:14.820061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b73eb-9195-4515-b3b6-a834d31ba440 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:14.820567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b73eb-9195-4515-b3b6-a834d31ba440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:14.833126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b73eb-9195-4515-b3b6-a834d31ba440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:14.835643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b73eb-9195-4515-b3b6-a834d31ba440 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:14.849786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 651/1309] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:17.531354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44a638-af5b-413b-8db5-34ed0c34b6be None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:17.531858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44a638-af5b-413b-8db5-34ed0c34b6be None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:17.531858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44a638-af5b-413b-8db5-34ed0c34b6be None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:17.533626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 659/1310] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:17.540640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da9c06-13ed-4833-82ff-b61ff3269e31 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:17.541492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da9c06-13ed-4833-82ff-b61ff3269e31 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:17.541992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da9c06-13ed-4833-82ff-b61ff3269e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:17.567178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d3da9c06-13ed-4833-82ff-b61ff3269e31 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:17.569183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3da9c06-13ed-4833-82ff-b61ff3269e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:17.579994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 652/1311] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:17.632427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd0d6b-46ad-457f-84fd-5816a7ef128a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:17.632706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd0d6b-46ad-457f-84fd-5816a7ef128a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:17.632987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd0d6b-46ad-457f-84fd-5816a7ef128a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:17.634809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 660/1312] 10.222.0.60 () {54 vars in 960 bytes} [Wed Nov 10 15:47:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:17.644475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c467f-26fc-4a30-8c25-ca7007638671 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:17.644750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c467f-26fc-4a30-8c25-ca7007638671 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:17.645209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c467f-26fc-4a30-8c25-ca7007638671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:17.668523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-186c467f-26fc-4a30-8c25-ca7007638671 None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:17.669941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-186c467f-26fc-4a30-8c25-ca7007638671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:17.681680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 653/1313] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Nov 10 15:47:17 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:17.689725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd0d6b-46ad-457f-84fd-5816a7ef128a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:17.706075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd0d6b-46ad-457f-84fd-5816a7ef128a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:17.712823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4259e-c81a-419b-bf2c-0a234f3b4a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:17.713493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4259e-c81a-419b-bf2c-0a234f3b4a29 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:17.713743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4259e-c81a-419b-bf2c-0a234f3b4a29 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:17.714028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4259e-c81a-419b-bf2c-0a234f3b4a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:17.726272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4259e-c81a-419b-bf2c-0a234f3b4a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:17.727874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4259e-c81a-419b-bf2c-0a234f3b4a29 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:17.738734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 661/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:19.836090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb564-f914-4e88-993a-99badfed9da5 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:19.836673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb564-f914-4e88-993a-99badfed9da5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:19.836673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb564-f914-4e88-993a-99badfed9da5 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:19.838463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 654/1315] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:19.845063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca643-bea9-4327-a397-c05b46c58d9b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:19.845683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca643-bea9-4327-a397-c05b46c58d9b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:19.845683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca643-bea9-4327-a397-c05b46c58d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:19.864705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-882ca643-bea9-4327-a397-c05b46c58d9b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:19.865912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-882ca643-bea9-4327-a397-c05b46c58d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:19.874512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 662/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:19.928615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfdbd3-c153-4d6d-9e52-7eac51eefc77 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:19.929196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfdbd3-c153-4d6d-9e52-7eac51eefc77 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:19.929678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfdbd3-c153-4d6d-9e52-7eac51eefc77 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:19.931480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 655/1317] 10.222.0.60 () {54 vars in 962 bytes} [Wed Nov 10 15:47:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:19.937247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1268-5185-46f8-8cf6-9b549eec4b50 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:19.937511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1268-5185-46f8-8cf6-9b549eec4b50 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:19.937967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1268-5185-46f8-8cf6-9b549eec4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:19.993952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-befc1268-5185-46f8-8cf6-9b549eec4b50 None None] MFA Rules not processed for user `f74dc52500784e41bce60a945035ab74`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:19.995882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-befc1268-5185-46f8-8cf6-9b549eec4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:20.077105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 663/1318] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Nov 10 15:47:19 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:20.084911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfdbd3-c153-4d6d-9e52-7eac51eefc77 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:20.097444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfdbd3-c153-4d6d-9e52-7eac51eefc77 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:20.102043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38af7ff-5e64-4fab-b35c-a9ab61706318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:20.102887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7ff-5e64-4fab-b35c-a9ab61706318 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:20.103255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7ff-5e64-4fab-b35c-a9ab61706318 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:20.103801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7ff-5e64-4fab-b35c-a9ab61706318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:20.114441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38af7ff-5e64-4fab-b35c-a9ab61706318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:20.116257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38af7ff-5e64-4fab-b35c-a9ab61706318 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:20.130739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 656/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:20.182194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921ecc8-75be-4c83-9f22-740bbd86ef31 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:20.182483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921ecc8-75be-4c83-9f22-740bbd86ef31 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:20.182846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921ecc8-75be-4c83-9f22-740bbd86ef31 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:20.184574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 664/1320] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:20.191897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f259bd-6be4-4ad5-b61a-2e61e5665ab9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:20.191897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f259bd-6be4-4ad5-b61a-2e61e5665ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:20.191897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f259bd-6be4-4ad5-b61a-2e61e5665ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:20.210330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-01f259bd-6be4-4ad5-b61a-2e61e5665ab9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:20.211549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-01f259bd-6be4-4ad5-b61a-2e61e5665ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:20.223727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 657/1321] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:20.273801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921ecc8-75be-4c83-9f22-740bbd86ef31 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:20.293216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921ecc8-75be-4c83-9f22-740bbd86ef31 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:20.299759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101709a5-e1aa-46cd-9db4-863a71d89965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:20.300870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101709a5-e1aa-46cd-9db4-863a71d89965 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:20.301386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101709a5-e1aa-46cd-9db4-863a71d89965 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:20.301751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101709a5-e1aa-46cd-9db4-863a71d89965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:20.311418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101709a5-e1aa-46cd-9db4-863a71d89965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:20.313235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101709a5-e1aa-46cd-9db4-863a71d89965 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:20.325848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 665/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:22.701959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fad1-b165-480b-95fd-03306f17a227 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:22.702560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fad1-b165-480b-95fd-03306f17a227 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:22.702560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fad1-b165-480b-95fd-03306f17a227 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:22.704571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 658/1323] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:22.710888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136aeea-ae31-4534-a3d1-4ac76e33caec None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:22.711683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136aeea-ae31-4534-a3d1-4ac76e33caec None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:22.712113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136aeea-ae31-4534-a3d1-4ac76e33caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:22.731529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5136aeea-ae31-4534-a3d1-4ac76e33caec None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:22.732765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5136aeea-ae31-4534-a3d1-4ac76e33caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:22.741291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 666/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:22.791187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fad1-b165-480b-95fd-03306f17a227 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:22.813616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fad1-b165-480b-95fd-03306f17a227 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:22.819359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d5a97-9e68-4987-893e-0090d0a18b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:22.820006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5a97-9e68-4987-893e-0090d0a18b84 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:22.820287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5a97-9e68-4987-893e-0090d0a18b84 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:22.820587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5a97-9e68-4987-893e-0090d0a18b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:22.830567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5a97-9e68-4987-893e-0090d0a18b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:22.832369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5a97-9e68-4987-893e-0090d0a18b84 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:22.842027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 659/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:25.416686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d63aa-bb18-4d0c-a9dc-ccf3cf6d5d24 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:25.417279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d63aa-bb18-4d0c-a9dc-ccf3cf6d5d24 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:25.417501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d63aa-bb18-4d0c-a9dc-ccf3cf6d5d24 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:25.419654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 667/1326] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:25.426525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62dfd-98d5-4775-bcd6-2e160819a177 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:25.427397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62dfd-98d5-4775-bcd6-2e160819a177 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:25.427819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62dfd-98d5-4775-bcd6-2e160819a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:25.447750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3df62dfd-98d5-4775-bcd6-2e160819a177 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:25.449002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3df62dfd-98d5-4775-bcd6-2e160819a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:25.457860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 660/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:25.515569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d63aa-bb18-4d0c-a9dc-ccf3cf6d5d24 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:25.532599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d63aa-bb18-4d0c-a9dc-ccf3cf6d5d24 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:25.539207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b545c96-048b-4c66-9707-5c8e74069432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:25.540192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b545c96-048b-4c66-9707-5c8e74069432 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:25.540450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b545c96-048b-4c66-9707-5c8e74069432 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:25.540718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b545c96-048b-4c66-9707-5c8e74069432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:25.549891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b545c96-048b-4c66-9707-5c8e74069432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:25.552369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b545c96-048b-4c66-9707-5c8e74069432 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:25.563357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 668/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:28.020001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c444194-2f01-46be-aee7-8e0454e4a120 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:28.020815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c444194-2f01-46be-aee7-8e0454e4a120 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:28.021454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c444194-2f01-46be-aee7-8e0454e4a120 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:28.025262 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 661/1329] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:28.031831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8777f-a6d6-47f2-978f-d6008ad4dbbf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:28.032811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8777f-a6d6-47f2-978f-d6008ad4dbbf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:28.032811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8777f-a6d6-47f2-978f-d6008ad4dbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:28.061778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ffa8777f-a6d6-47f2-978f-d6008ad4dbbf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:28.063937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ffa8777f-a6d6-47f2-978f-d6008ad4dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:28.077517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 669/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:28.140587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c444194-2f01-46be-aee7-8e0454e4a120 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:28.161460 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c444194-2f01-46be-aee7-8e0454e4a120 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:28.170134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98ac0-7bc8-4a69-a8de-764d9a1f6692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:28.171056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98ac0-7bc8-4a69-a8de-764d9a1f6692 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:28.171436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98ac0-7bc8-4a69-a8de-764d9a1f6692 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:28.171793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98ac0-7bc8-4a69-a8de-764d9a1f6692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:28.184862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff98ac0-7bc8-4a69-a8de-764d9a1f6692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:28.186630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff98ac0-7bc8-4a69-a8de-764d9a1f6692 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:28.198621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 662/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:31.191563 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183b7cd-8334-4393-9f50-68d141635eb2 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:31.192276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183b7cd-8334-4393-9f50-68d141635eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:31.192934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183b7cd-8334-4393-9f50-68d141635eb2 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:31.198060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 670/1332] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:31 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:31.207532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f095a2-2c19-40e6-bef3-cc271bdc2099 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:31.208289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f095a2-2c19-40e6-bef3-cc271bdc2099 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:31.208289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f095a2-2c19-40e6-bef3-cc271bdc2099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:31.228757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a1f095a2-2c19-40e6-bef3-cc271bdc2099 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:31.230133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a1f095a2-2c19-40e6-bef3-cc271bdc2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:31.242613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 663/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:31.310096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183b7cd-8334-4393-9f50-68d141635eb2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:31.330743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183b7cd-8334-4393-9f50-68d141635eb2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:31.336809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6bd08-cea4-43e3-a3f2-2481a05423b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:31.337533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6bd08-cea4-43e3-a3f2-2481a05423b0 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:31.337816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6bd08-cea4-43e3-a3f2-2481a05423b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:31.338315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6bd08-cea4-43e3-a3f2-2481a05423b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:31.351544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6bd08-cea4-43e3-a3f2-2481a05423b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:31.354601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6bd08-cea4-43e3-a3f2-2481a05423b0 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:31.369926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 671/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:33.782822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfc35-ef83-45a9-82c9-601ecfc9a83e None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:33.783385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfc35-ef83-45a9-82c9-601ecfc9a83e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:33.783385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfc35-ef83-45a9-82c9-601ecfc9a83e None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:33.785747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 664/1335] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:33.793319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d920-9d26-41e8-b2cf-1a9ed7ca0681 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:33.794003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d920-9d26-41e8-b2cf-1a9ed7ca0681 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:33.794003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d920-9d26-41e8-b2cf-1a9ed7ca0681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:33.813628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0ec5d920-9d26-41e8-b2cf-1a9ed7ca0681 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:33.814889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0ec5d920-9d26-41e8-b2cf-1a9ed7ca0681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:33.823482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 672/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:33.876899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfc35-ef83-45a9-82c9-601ecfc9a83e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:33.894137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfc35-ef83-45a9-82c9-601ecfc9a83e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:33.901763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3280e-ab35-4337-a558-e11def0d6176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:33.902451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3280e-ab35-4337-a558-e11def0d6176 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:33.902728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3280e-ab35-4337-a558-e11def0d6176 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:33.903006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3280e-ab35-4337-a558-e11def0d6176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:33.913183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3280e-ab35-4337-a558-e11def0d6176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:33.915443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3280e-ab35-4337-a558-e11def0d6176 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:33.927838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 665/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:35.732661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147e57-04ff-4f86-9a26-7969128f6a19 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:35.733109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147e57-04ff-4f86-9a26-7969128f6a19 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:35.733310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147e57-04ff-4f86-9a26-7969128f6a19 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:35.735248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 673/1338] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:35.742653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267e150-70d6-4746-845f-adee587e3a50 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:35.743135 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267e150-70d6-4746-845f-adee587e3a50 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:35.743243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267e150-70d6-4746-845f-adee587e3a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:35.763421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2267e150-70d6-4746-845f-adee587e3a50 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:35.764670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2267e150-70d6-4746-845f-adee587e3a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:35.774513 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 666/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:35.844047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529215d-4ae8-496d-bb7e-7e32a5cd2747 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:35.844367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529215d-4ae8-496d-bb7e-7e32a5cd2747 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:35.844641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529215d-4ae8-496d-bb7e-7e32a5cd2747 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:35.846503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 674/1340] 10.222.0.60 () {54 vars in 962 bytes} [Wed Nov 10 15:47:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:35.852506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01d5e-eb00-4be0-92db-4e88f4c878ec None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:35.853096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01d5e-eb00-4be0-92db-4e88f4c878ec None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:35.853459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01d5e-eb00-4be0-92db-4e88f4c878ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:35.911012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7cf01d5e-eb00-4be0-92db-4e88f4c878ec None None] MFA Rules not processed for user `06999fb0772947f584d5608ca26f9352`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:35.912241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7cf01d5e-eb00-4be0-92db-4e88f4c878ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:35.981507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 667/1341] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Nov 10 15:47:35 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:35.989958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529215d-4ae8-496d-bb7e-7e32a5cd2747 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:36.000980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529215d-4ae8-496d-bb7e-7e32a5cd2747 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:36.004746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dedf8-0aa7-4c34-b6b2-f284248664e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:36.005410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dedf8-0aa7-4c34-b6b2-f284248664e8 service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.005687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dedf8-0aa7-4c34-b6b2-f284248664e8 service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.005971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dedf8-0aa7-4c34-b6b2-f284248664e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.017347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dedf8-0aa7-4c34-b6b2-f284248664e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:36.019303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dedf8-0aa7-4c34-b6b2-f284248664e8 service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:36.030347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 675/1342] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:36.344446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8a7e-0ac5-4b90-a891-8018c968a96c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.344758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8a7e-0ac5-4b90-a891-8018c968a96c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.345033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8a7e-0ac5-4b90-a891-8018c968a96c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.347206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 668/1343] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:36.353671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0371c1-138c-43b0-a334-3a0466d43d3b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.354028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0371c1-138c-43b0-a334-3a0466d43d3b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.354430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0371c1-138c-43b0-a334-3a0466d43d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.374512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-aa0371c1-138c-43b0-a334-3a0466d43d3b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:36.375957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aa0371c1-138c-43b0-a334-3a0466d43d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:36.385372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 676/1344] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:36.443112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a8a7e-0ac5-4b90-a891-8018c968a96c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:36.460391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a8a7e-0ac5-4b90-a891-8018c968a96c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:36.467666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b0946-4cee-49ba-8548-dd8ce97607eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:36.468533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b0946-4cee-49ba-8548-dd8ce97607eb service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.468809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b0946-4cee-49ba-8548-dd8ce97607eb service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.469079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b0946-4cee-49ba-8548-dd8ce97607eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.479498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b0946-4cee-49ba-8548-dd8ce97607eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:36.481318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b0946-4cee-49ba-8548-dd8ce97607eb service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:36.493106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 669/1345] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:36.576487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746353-b203-4d31-9db8-f8bdc0ced877 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.576780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746353-b203-4d31-9db8-f8bdc0ced877 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.577065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746353-b203-4d31-9db8-f8bdc0ced877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.656227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8e746353-b203-4d31-9db8-f8bdc0ced877 None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:36.657446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8e746353-b203-4d31-9db8-f8bdc0ced877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:36.741189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 677/1346] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:47:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:36.793396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8619ca-9056-475c-beb5-73c971d9a50a None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.794005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8619ca-9056-475c-beb5-73c971d9a50a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.794005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8619ca-9056-475c-beb5-73c971d9a50a None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.796511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 670/1347] 10.222.0.60 () {54 vars in 942 bytes} [Wed Nov 10 15:47:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:36.806104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed1851-f760-4739-bbb8-cabe00fbdadc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.806652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed1851-f760-4739-bbb8-cabe00fbdadc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.806946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed1851-f760-4739-bbb8-cabe00fbdadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.866115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b6ed1851-f760-4739-bbb8-cabe00fbdadc None None] MFA Rules not processed for user `025c8b235c244612932e1c931b40cf35`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:36.867446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b6ed1851-f760-4739-bbb8-cabe00fbdadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:36.950696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 678/1348] 10.222.0.60 () {58 vars in 1039 bytes} [Wed Nov 10 15:47:36 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:36.962104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8619ca-9056-475c-beb5-73c971d9a50a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:36.978767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8619ca-9056-475c-beb5-73c971d9a50a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:36.985904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec691c8-ebfb-4636-bf0a-129ffa5e89f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:36.986730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec691c8-ebfb-4636-bf0a-129ffa5e89f6 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:36.987017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec691c8-ebfb-4636-bf0a-129ffa5e89f6 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:36.987908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec691c8-ebfb-4636-bf0a-129ffa5e89f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:36.999520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec691c8-ebfb-4636-bf0a-129ffa5e89f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:37.001395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec691c8-ebfb-4636-bf0a-129ffa5e89f6 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:37.012737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 671/1349] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:47:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:47:39.052829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7619-a54b-478e-860d-a16fd1e80263 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:39.053821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7619-a54b-478e-860d-a16fd1e80263 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:39.054258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7619-a54b-478e-860d-a16fd1e80263 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:39.058565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 679/1350] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:39.063053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4de6-4261-4f70-b65f-ed88a4a13533 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:39.064052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4de6-4261-4f70-b65f-ed88a4a13533 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:39.064752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4de6-4261-4f70-b65f-ed88a4a13533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:39.093587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c24d4de6-4261-4f70-b65f-ed88a4a13533 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:39.095779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c24d4de6-4261-4f70-b65f-ed88a4a13533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:39.105861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 672/1351] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:39.162634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7619-a54b-478e-860d-a16fd1e80263 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:39.188843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7619-a54b-478e-860d-a16fd1e80263 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:39.197517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412905cd-24c1-461a-a0e8-a4ef9b988438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:39.198591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412905cd-24c1-461a-a0e8-a4ef9b988438 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:39.198980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412905cd-24c1-461a-a0e8-a4ef9b988438 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:39.199264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412905cd-24c1-461a-a0e8-a4ef9b988438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:39.219787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412905cd-24c1-461a-a0e8-a4ef9b988438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:39.222264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412905cd-24c1-461a-a0e8-a4ef9b988438 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:39.253475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 680/1352] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:41.859039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7369e-d92a-42e7-bab4-431b4fb40944 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:41.859634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7369e-d92a-42e7-bab4-431b4fb40944 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:41.859634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7369e-d92a-42e7-bab4-431b4fb40944 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:41.861392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 673/1353] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:41.867702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd889487-be56-4479-ba77-137476f4b39b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:41.868181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd889487-be56-4479-ba77-137476f4b39b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:41.868286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd889487-be56-4479-ba77-137476f4b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:41.889788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fd889487-be56-4479-ba77-137476f4b39b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:41.891295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fd889487-be56-4479-ba77-137476f4b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:41.906570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 681/1354] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:41.949068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7369e-d92a-42e7-bab4-431b4fb40944 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:41.967006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7369e-d92a-42e7-bab4-431b4fb40944 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:41.973098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ba4f2-d0e1-42f2-ab4a-83210016c1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:41.973750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba4f2-d0e1-42f2-ab4a-83210016c1ad service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:41.974025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba4f2-d0e1-42f2-ab4a-83210016c1ad service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:41.974335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ba4f2-d0e1-42f2-ab4a-83210016c1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:41.983455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ba4f2-d0e1-42f2-ab4a-83210016c1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:41.987160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ba4f2-d0e1-42f2-ab4a-83210016c1ad service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:41.995961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 674/1355] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:47:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:47:55.124118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb150-b81c-43cb-970d-802651dee841 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:55.124750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb150-b81c-43cb-970d-802651dee841 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:55.124750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb150-b81c-43cb-970d-802651dee841 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:55.126621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 682/1356] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:55.133561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaeecc-4557-4509-8b85-60f40e170d94 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:55.134105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaeecc-4557-4509-8b85-60f40e170d94 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:55.134105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaeecc-4557-4509-8b85-60f40e170d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:55.154173 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7fdaeecc-4557-4509-8b85-60f40e170d94 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:55.155429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7fdaeecc-4557-4509-8b85-60f40e170d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:55.165480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 675/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:55.193053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb150-b81c-43cb-970d-802651dee841 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:55.207317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb150-b81c-43cb-970d-802651dee841 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:55.212301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b23299-0e37-4305-8a0e-c79fceb3755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:55.212984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23299-0e37-4305-8a0e-c79fceb3755c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:55.213257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23299-0e37-4305-8a0e-c79fceb3755c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:55.213541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b23299-0e37-4305-8a0e-c79fceb3755c admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:55.214464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b23299-0e37-4305-8a0e-c79fceb3755c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:55.216323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b23299-0e37-4305-8a0e-c79fceb3755c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:55.236542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 683/1358] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:47:55 2021] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:47:57.539548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c436-c475-4b39-afb3-aaf0e581e2de None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:57.540462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c436-c475-4b39-afb3-aaf0e581e2de None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:57.540462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c436-c475-4b39-afb3-aaf0e581e2de None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:57.542179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 676/1359] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:47:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:47:57.548637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:57.549289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:57.549289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:57.569800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:47:57.571079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:47:57.579498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 684/1360] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:47:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:47:57.604532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115c436-c475-4b39-afb3-aaf0e581e2de None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:57.618902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115c436-c475-4b39-afb3-aaf0e581e2de None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:57.623808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:57.624667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:57.624945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:57.625217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] PATH_INFO: `/v3/projects/362d90efb4b747d58c8804a0c65f2b88` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:57.636965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] RBAC: Authorizing `identity:get_project(project_id=362d90efb4b747d58c8804a0c65f2b88)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:57.639076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:57.640900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 677/1361] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:47:57 2021] GET /identity/v3/projects/362d90efb4b747d58c8804a0c65f2b88 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:47:57.649825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:57.659943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a78469-da05-4df7-a1ae-356991d8f2bb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:57.666708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:57.667374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:57.667651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:57.667921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:57.668721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] RBAC: Adding query filter params (scope.project.id=362d90efb4b747d58c8804a0c65f2b88) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:47:57.669023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:57.670988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:57.679181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 685/1362] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:47:57 2021] GET /identity/v3/role_assignments?scope.project.id=362d90efb4b747d58c8804a0c65f2b88 => generated 877 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:47:57.686408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:57.697813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28374a-9747-401c-bcb5-04eab07cdbbd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:57.702808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65379698-5e75-4895-94b4-c103519e8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:57.703722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379698-5e75-4895-94b4-c103519e8e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:57.703996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379698-5e75-4895-94b4-c103519e8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:57.704261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379698-5e75-4895-94b4-c103519e8e7b admin admin] PATH_INFO: `/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:57.719347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65379698-5e75-4895-94b4-c103519e8e7b admin admin] RBAC: Authorizing `identity:get_user(user_id=c8b987e18cc24b9c8ad964ea1e8ca265)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:57.721788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65379698-5e75-4895-94b4-c103519e8e7b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:57.724077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 678/1363] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:47:57 2021] GET /identity/v3/users/c8b987e18cc24b9c8ad964ea1e8ca265 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:47:57.730929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:47:57.741724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970a667-55c7-4db0-a0b1-e8cab97b7e6f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:47:57.746989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964fb68-d627-4060-b2e1-7846d244e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:47:57.747897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964fb68-d627-4060-b2e1-7846d244e6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:47:57.748432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964fb68-d627-4060-b2e1-7846d244e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:47:57.748713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964fb68-d627-4060-b2e1-7846d244e6f9 admin admin] PATH_INFO: `/v3/users/5828f78cda844876aa9296dd7d70d17d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:47:57.764428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964fb68-d627-4060-b2e1-7846d244e6f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5828f78cda844876aa9296dd7d70d17d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:47:57.766662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964fb68-d627-4060-b2e1-7846d244e6f9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:47:57.768486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 686/1364] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:47:57 2021] GET /identity/v3/users/5828f78cda844876aa9296dd7d70d17d => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:00.152362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12777a3-6ca8-4831-81d3-09e776f29b37 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:00.152362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12777a3-6ca8-4831-81d3-09e776f29b37 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:00.153064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12777a3-6ca8-4831-81d3-09e776f29b37 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:00.154576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 679/1365] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:00.161381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:00.161991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:00.161991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:00.182518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:00.183849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:00.193193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 687/1366] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:00.218549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12777a3-6ca8-4831-81d3-09e776f29b37 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:00.233139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12777a3-6ca8-4831-81d3-09e776f29b37 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:00.238699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:00.239627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:00.239909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:00.240188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] PATH_INFO: `/v3/projects/43295c5b258041acb98f3fb32ccaba4d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:00.254594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=43295c5b258041acb98f3fb32ccaba4d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:00.257138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:00.259199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 680/1367] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:48:00 2021] GET /identity/v3/projects/43295c5b258041acb98f3fb32ccaba4d => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:00.268184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:00.279408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfadc-b5e9-4fad-bfa1-53bca8372cfa None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:00.285342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:00.286045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:00.286369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:00.286653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:00.287468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] RBAC: Adding query filter params (scope.project.id=43295c5b258041acb98f3fb32ccaba4d) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:48:00.287773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:00.290064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97dadf-d05d-496f-b2ae-fcae5a4cfb4b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:00.296809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 688/1368] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:48:00 2021] GET /identity/v3/role_assignments?scope.project.id=43295c5b258041acb98f3fb32ccaba4d => generated 526 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:00.304138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:00.315125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa0e0-5ebc-4e19-b3fc-26294b6212a3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:00.320975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552c116-30e8-48b7-80fd-3b20c929c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:00.321960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c116-30e8-48b7-80fd-3b20c929c627 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:00.322279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c116-30e8-48b7-80fd-3b20c929c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:00.322561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c116-30e8-48b7-80fd-3b20c929c627 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:00.340132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552c116-30e8-48b7-80fd-3b20c929c627 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:00.342437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552c116-30e8-48b7-80fd-3b20c929c627 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:00.344334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 681/1369] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:00 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:02.730104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33689f-bf3c-4524-a5b8-67c7f3bac6be None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:02.730694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33689f-bf3c-4524-a5b8-67c7f3bac6be None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:02.730694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33689f-bf3c-4524-a5b8-67c7f3bac6be None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:02.732372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 689/1370] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:02.738943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:02.739398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:02.739489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:02.757579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:02.758799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:02.767203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 682/1371] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:02.791374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33689f-bf3c-4524-a5b8-67c7f3bac6be None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:02.805800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33689f-bf3c-4524-a5b8-67c7f3bac6be None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:02.810788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:02.811639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:02.811914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:02.812181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] PATH_INFO: `/v3/projects/5257eb1aa0954376ba58fe4f7b901cea` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:02.813400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] RBAC: Authorizing `identity:get_project(project_id=5257eb1aa0954376ba58fe4f7b901cea)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:02.815314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:02.817532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 690/1372] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:48:02 2021] GET /identity/v3/projects/5257eb1aa0954376ba58fe4f7b901cea => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:02.826017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:02.836572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c8339-41f4-4b0d-9450-5d7a44a927bb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:02.841802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:02.842512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:02.842795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:02.843067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:02.843865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] RBAC: Adding query filter params (scope.project.id=5257eb1aa0954376ba58fe4f7b901cea) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:48:02.844171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:02.846058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5cf6b-84a7-4494-9055-2fcfa21d5335 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:02.854143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 683/1373] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:48:02 2021] GET /identity/v3/role_assignments?scope.project.id=5257eb1aa0954376ba58fe4f7b901cea => generated 879 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:02.861200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:02.872039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865b69-1456-40b6-aa6a-80ac85f3e2ad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:02.877134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093065dd-8bab-4139-bce5-399606ae6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:02.877999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093065dd-8bab-4139-bce5-399606ae6701 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:02.878422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093065dd-8bab-4139-bce5-399606ae6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:02.878711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093065dd-8bab-4139-bce5-399606ae6701 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:02.879973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093065dd-8bab-4139-bce5-399606ae6701 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:02.881791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093065dd-8bab-4139-bce5-399606ae6701 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:02.883475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 691/1374] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:02 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:05.747573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56be05-4f13-45cb-8dc4-0739af1a05aa None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:05.748413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56be05-4f13-45cb-8dc4-0739af1a05aa None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:05.748413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56be05-4f13-45cb-8dc4-0739af1a05aa None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:05.750044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 684/1375] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:05.759391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:05.760090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:05.760090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:05.785399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:05.787061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:05.800319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 692/1376] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:05.837396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56be05-4f13-45cb-8dc4-0739af1a05aa None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:05.852260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56be05-4f13-45cb-8dc4-0739af1a05aa None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:05.857239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:05.858120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:05.858416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:05.858695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] PATH_INFO: `/v3/projects/5f7137fe87274f71a161236859836d66` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:05.873934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] RBAC: Authorizing `identity:get_project(project_id=5f7137fe87274f71a161236859836d66)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:05.876174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:05.878118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 685/1377] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:48:05 2021] GET /identity/v3/projects/5f7137fe87274f71a161236859836d66 => generated 311 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:48:05.887141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:05.899576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169eba-2927-480b-a906-f5ea94c6f488 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:05.905175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:05.905858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:05.906138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:05.906454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:05.907253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] RBAC: Adding query filter params (scope.project.id=5f7137fe87274f71a161236859836d66) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:48:05.907561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:05.909651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16272909-182c-4e0c-81c2-800d51961e82 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:05.917145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 693/1378] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:48:05 2021] GET /identity/v3/role_assignments?scope.project.id=5f7137fe87274f71a161236859836d66 => generated 526 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:05.924821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:05.936805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837b07-6187-4152-91b8-7355b376a60d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:05.942083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e4dd1-c589-4ed8-b289-1532b2d0b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:05.943089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4dd1-c589-4ed8-b289-1532b2d0b136 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:05.943378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4dd1-c589-4ed8-b289-1532b2d0b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:05.943694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e4dd1-c589-4ed8-b289-1532b2d0b136 admin admin] PATH_INFO: `/v3/users/8dfc13eba3f14f0fa9ec2063303f261e` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:05.961769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e4dd1-c589-4ed8-b289-1532b2d0b136 admin admin] RBAC: Authorizing `identity:get_user(user_id=8dfc13eba3f14f0fa9ec2063303f261e)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:05.964275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e4dd1-c589-4ed8-b289-1532b2d0b136 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:05.966140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 686/1379] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:05 2021] GET /identity/v3/users/8dfc13eba3f14f0fa9ec2063303f261e => generated 286 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:08.595406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738d39-42ac-4ff2-af3c-64ed505cd3b0 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:08.596206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738d39-42ac-4ff2-af3c-64ed505cd3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:08.596206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738d39-42ac-4ff2-af3c-64ed505cd3b0 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:08.598737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 694/1380] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:08.606043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:08.606774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:08.606907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:08.629042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:08.630735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:08.642082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 687/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:08.683277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738d39-42ac-4ff2-af3c-64ed505cd3b0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:08.704401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738d39-42ac-4ff2-af3c-64ed505cd3b0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:08.712371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:08.713896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:08.714475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:08.714891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] PATH_INFO: `/v3/projects/6d553deefeab49daaeb29401ad6f9a26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:08.735557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d553deefeab49daaeb29401ad6f9a26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:08.739615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:08.742880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 695/1382] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:48:08 2021] GET /identity/v3/projects/6d553deefeab49daaeb29401ad6f9a26 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:08.756471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:08.773670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33844-4a3d-4f55-9a98-a6f047feb5a9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:08.782033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:08.783279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:08.783786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:08.784271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:08.785892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] RBAC: Adding query filter params (scope.project.id=6d553deefeab49daaeb29401ad6f9a26) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:48:08.786508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:08.790488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:08.804394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 688/1383] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:48:08 2021] GET /identity/v3/role_assignments?scope.project.id=6d553deefeab49daaeb29401ad6f9a26 => generated 1934 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:48:08.816895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:08.837120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9df3c5-5aff-4840-b8e4-28269c4919d0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:08.845585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819227dd-93af-4d24-9e18-b19bc4977af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:08.847098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819227dd-93af-4d24-9e18-b19bc4977af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:08.847578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819227dd-93af-4d24-9e18-b19bc4977af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:08.848058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819227dd-93af-4d24-9e18-b19bc4977af0 admin admin] PATH_INFO: `/v3/users/6f6e729c07b0473793742efdbd331d64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:08.850383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819227dd-93af-4d24-9e18-b19bc4977af0 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f6e729c07b0473793742efdbd331d64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:08.854400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819227dd-93af-4d24-9e18-b19bc4977af0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:08.857604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 696/1384] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:08 2021] GET /identity/v3/users/6f6e729c07b0473793742efdbd331d64 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:08.869411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:08.888293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07617e-96d6-4082-ab79-5fe96e1e10b9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:08.897413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e6cfc-b7f8-4612-aa8b-62f601d3a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:08.899060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6cfc-b7f8-4612-aa8b-62f601d3a807 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:08.899560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6cfc-b7f8-4612-aa8b-62f601d3a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:08.900073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6cfc-b7f8-4612-aa8b-62f601d3a807 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:08.902558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e6cfc-b7f8-4612-aa8b-62f601d3a807 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:08.906097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e6cfc-b7f8-4612-aa8b-62f601d3a807 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:08.909680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 689/1385] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:08 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:11.506553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e18c-1129-413c-98e3-e339ff1c16bc None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:11.507134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e18c-1129-413c-98e3-e339ff1c16bc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:11.507134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e18c-1129-413c-98e3-e339ff1c16bc None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:11.508807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 697/1386] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:48:11.515674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:11.516245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:11.516245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:11.536235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:11.537471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:11.546648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 690/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:11.572145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40e18c-1129-413c-98e3-e339ff1c16bc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:11.586320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40e18c-1129-413c-98e3-e339ff1c16bc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:11.591065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:11.591945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:11.592228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:11.592498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] PATH_INFO: `/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:11.605631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] RBAC: Authorizing `identity:get_project(project_id=8cf256a8ab1a4331badc15e5fb8b7c67)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:11.608048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:11.610191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 698/1388] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:48:11 2021] GET /identity/v3/projects/8cf256a8ab1a4331badc15e5fb8b7c67 => generated 361 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:11.619372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:11.629935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f03857-f3a3-4077-a033-92d19f8cf4f1 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:11.638685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:11.638685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:11.638685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:11.638685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:11.639158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] RBAC: Adding query filter params (scope.project.id=8cf256a8ab1a4331badc15e5fb8b7c67) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:48:11.639158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:11.640479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009692-97d3-48a8-bd34-b3a6dea85b69 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:11.647279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 691/1389] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:48:11 2021] GET /identity/v3/role_assignments?scope.project.id=8cf256a8ab1a4331badc15e5fb8b7c67 => generated 526 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:48:11.654257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:11.665482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a3f72-4048-4ca3-b2b4-05695b1a9822 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:11.670665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842db31-73bd-400f-a7e1-fd3ff3b00e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:11.671549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842db31-73bd-400f-a7e1-fd3ff3b00e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:11.671828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842db31-73bd-400f-a7e1-fd3ff3b00e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:11.672102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842db31-73bd-400f-a7e1-fd3ff3b00e5f admin admin] PATH_INFO: `/v3/users/af05d316095d45139a767f8f28d35632` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:11.688541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842db31-73bd-400f-a7e1-fd3ff3b00e5f admin admin] RBAC: Authorizing `identity:get_user(user_id=af05d316095d45139a767f8f28d35632)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:11.690834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842db31-73bd-400f-a7e1-fd3ff3b00e5f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:11.692667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 699/1390] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:11 2021] GET /identity/v3/users/af05d316095d45139a767f8f28d35632 => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:14.137955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe663bc-7653-4cb6-85be-dbb6b148246c None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:14.138591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe663bc-7653-4cb6-85be-dbb6b148246c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:14.138768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe663bc-7653-4cb6-85be-dbb6b148246c None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:14.142020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 692/1391] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:14 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:14.151929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:14.152506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:14.152506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:14.172554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:14.173790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:14.188996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 700/1392] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:14.214362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe663bc-7653-4cb6-85be-dbb6b148246c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:14.228696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe663bc-7653-4cb6-85be-dbb6b148246c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:14.233511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:14.234427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:14.234704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:14.234978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] PATH_INFO: `/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:14.247780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a5ba90ce2c4b58af3126c1c1cfd78f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:14.249948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:14.251931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 693/1393] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Nov 10 15:48:14 2021] GET /identity/v3/projects/a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:14.260623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:14.271094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70bcc2-4d61-42d0-9dec-3cf8141639de None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:14.279307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:14.280100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:14.280632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:14.281124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:14.282482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] RBAC: Adding query filter params (scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:48:14.282792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:14.284774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:14.292822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 701/1394] 10.222.0.60 () {56 vars in 1231 bytes} [Wed Nov 10 15:48:14 2021] GET /identity/v3/role_assignments?scope.project.id=a7a5ba90ce2c4b58af3126c1c1cfd78f => generated 1934 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:48:14.300485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:14.316193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ccb6c-864e-4184-b7cc-d3282d02e13a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:14.323291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70f560-62b7-438b-b95f-54ff3e630928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:14.324565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f560-62b7-438b-b95f-54ff3e630928 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:14.325010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f560-62b7-438b-b95f-54ff3e630928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:14.325477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70f560-62b7-438b-b95f-54ff3e630928 admin admin] PATH_INFO: `/v3/users/b99c3887940341efa66a07ec4208c158` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:14.348405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f560-62b7-438b-b95f-54ff3e630928 admin admin] RBAC: Authorizing `identity:get_user(user_id=b99c3887940341efa66a07ec4208c158)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:14.351820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70f560-62b7-438b-b95f-54ff3e630928 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:14.354521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 694/1395] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:14 2021] GET /identity/v3/users/b99c3887940341efa66a07ec4208c158 => generated 283 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:48:14.361634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:14.373018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894968-f308-4412-a0e3-0cb1923d3f8b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:14.379278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b4fc-869e-461b-86c9-75234e977910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:14.380255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b4fc-869e-461b-86c9-75234e977910 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:14.380528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b4fc-869e-461b-86c9-75234e977910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:14.380800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b4fc-869e-461b-86c9-75234e977910 admin admin] PATH_INFO: `/v3/users/0d0f0af1db944cb5ab99675a88ef9fef` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:14.382123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10b4fc-869e-461b-86c9-75234e977910 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d0f0af1db944cb5ab99675a88ef9fef)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:14.383995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10b4fc-869e-461b-86c9-75234e977910 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:14.385691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 702/1396] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Nov 10 15:48:14 2021] GET /identity/v3/users/0d0f0af1db944cb5ab99675a88ef9fef => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:48:20.146572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4fcf-28e9-4c79-9142-1b889aca6a02 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:20.147423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4fcf-28e9-4c79-9142-1b889aca6a02 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:20.147423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4fcf-28e9-4c79-9142-1b889aca6a02 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:20.149870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 695/1397] 10.222.0.60 () {54 vars in 918 bytes} [Wed Nov 10 15:48:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:20.156538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998b0b-bcc7-4a14-9fe7-4667fee877a1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:20.157049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998b0b-bcc7-4a14-9fe7-4667fee877a1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:20.157049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998b0b-bcc7-4a14-9fe7-4667fee877a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:20.178051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e1998b0b-bcc7-4a14-9fe7-4667fee877a1 None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:20.179422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e1998b0b-bcc7-4a14-9fe7-4667fee877a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:20.189833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 703/1398] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Nov 10 15:48:20 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:20.208136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34480c8a-f615-47f7-922b-b89753b79e21 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:20.208421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34480c8a-f615-47f7-922b-b89753b79e21 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:20.208696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34480c8a-f615-47f7-922b-b89753b79e21 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:20.210570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 696/1399] 10.222.0.60 () {54 vars in 918 bytes} [Wed Nov 10 15:48:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:48:20.216763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21278b-3d45-48b8-8f3c-4e3968c9e08d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:20.217048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21278b-3d45-48b8-8f3c-4e3968c9e08d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:20.217326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21278b-3d45-48b8-8f3c-4e3968c9e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:20.236498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8e21278b-3d45-48b8-8f3c-4e3968c9e08d None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:20.237749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8e21278b-3d45-48b8-8f3c-4e3968c9e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:20.249368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 704/1400] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Nov 10 15:48:20 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:48:23.242023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e637-1686-4bfb-8c86-14e3419524f6 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:23.243001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e637-1686-4bfb-8c86-14e3419524f6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:23.243001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e637-1686-4bfb-8c86-14e3419524f6 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:23.245386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 697/1401] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:23.252540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd40c5-9133-438c-a8a7-84c2d1340bc2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:23.253011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd40c5-9133-438c-a8a7-84c2d1340bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:23.253112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd40c5-9133-438c-a8a7-84c2d1340bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:23.273252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8cdd40c5-9133-438c-a8a7-84c2d1340bc2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:23.274569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8cdd40c5-9133-438c-a8a7-84c2d1340bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:23.283116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 705/1402] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:23.332886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e637-1686-4bfb-8c86-14e3419524f6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:23.348542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e637-1686-4bfb-8c86-14e3419524f6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:23.354420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b341a-1618-4e3f-a1ae-6bd29234e4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:23.355076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b341a-1618-4e3f-a1ae-6bd29234e4b6 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:23.355357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b341a-1618-4e3f-a1ae-6bd29234e4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:23.355629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b341a-1618-4e3f-a1ae-6bd29234e4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:23.364733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b341a-1618-4e3f-a1ae-6bd29234e4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:23.366401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b341a-1618-4e3f-a1ae-6bd29234e4b6 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:23.376124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 698/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:24.918666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86323f58-0b09-4651-9efd-52811808890d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:24.919291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86323f58-0b09-4651-9efd-52811808890d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:24.919291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86323f58-0b09-4651-9efd-52811808890d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:24.921734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 706/1404] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:24.928700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101cd3-479b-4c69-b3b4-6b701c714904 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:24.929217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101cd3-479b-4c69-b3b4-6b701c714904 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:24.929314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101cd3-479b-4c69-b3b4-6b701c714904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:24.947664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-cc101cd3-479b-4c69-b3b4-6b701c714904 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:24.948928 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cc101cd3-479b-4c69-b3b4-6b701c714904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:24.957891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 699/1405] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:25.114376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86323f58-0b09-4651-9efd-52811808890d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:25.138552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86323f58-0b09-4651-9efd-52811808890d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:25.144203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd2f39-bd17-4f03-9261-b3e35cfda714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:25.144933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2f39-bd17-4f03-9261-b3e35cfda714 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:25.145233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2f39-bd17-4f03-9261-b3e35cfda714 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:25.145504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2f39-bd17-4f03-9261-b3e35cfda714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:25.154293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd2f39-bd17-4f03-9261-b3e35cfda714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:25.155971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd2f39-bd17-4f03-9261-b3e35cfda714 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:25.166589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 707/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:26.725441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77336f-d065-45ff-bc76-179d5c7c8bf1 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:26.726002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77336f-d065-45ff-bc76-179d5c7c8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:26.726002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77336f-d065-45ff-bc76-179d5c7c8bf1 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:26.728045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 700/1407] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:26.734579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaf99c-eaab-45cb-b0e6-dcaa18e271b0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:26.735118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaf99c-eaab-45cb-b0e6-dcaa18e271b0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:26.735118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaf99c-eaab-45cb-b0e6-dcaa18e271b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:26.754416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e7eaf99c-eaab-45cb-b0e6-dcaa18e271b0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:26.755627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e7eaf99c-eaab-45cb-b0e6-dcaa18e271b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:26.764184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 708/1408] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:26.923518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77336f-d065-45ff-bc76-179d5c7c8bf1 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:26.938892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77336f-d065-45ff-bc76-179d5c7c8bf1 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:26.945398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac50f40-4c23-4625-a406-9170aecf8893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:26.946182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50f40-4c23-4625-a406-9170aecf8893 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:26.946536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50f40-4c23-4625-a406-9170aecf8893 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:26.946859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50f40-4c23-4625-a406-9170aecf8893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:26.955968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac50f40-4c23-4625-a406-9170aecf8893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:26.957938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac50f40-4c23-4625-a406-9170aecf8893 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:26.967953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 701/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:28.464967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc4460-0179-49c6-842e-0ec9c5602f6e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:28.465573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc4460-0179-49c6-842e-0ec9c5602f6e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:28.465573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc4460-0179-49c6-842e-0ec9c5602f6e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:28.467357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 709/1410] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:28.473163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df44e1-c081-407e-92dc-45f34cd5e19b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:28.473675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df44e1-c081-407e-92dc-45f34cd5e19b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:28.473675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df44e1-c081-407e-92dc-45f34cd5e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:28.493710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-36df44e1-c081-407e-92dc-45f34cd5e19b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:28.495269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-36df44e1-c081-407e-92dc-45f34cd5e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:28.505325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 702/1411] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:28.666309 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc4460-0179-49c6-842e-0ec9c5602f6e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:28.682423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc4460-0179-49c6-842e-0ec9c5602f6e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:28.688490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f50e3-a3dd-470b-bc51-a8e7f1aee8db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:28.689220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f50e3-a3dd-470b-bc51-a8e7f1aee8db service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:28.689358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f50e3-a3dd-470b-bc51-a8e7f1aee8db service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:28.689649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f50e3-a3dd-470b-bc51-a8e7f1aee8db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:28.699834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f50e3-a3dd-470b-bc51-a8e7f1aee8db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:28.701439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f50e3-a3dd-470b-bc51-a8e7f1aee8db service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:28.711682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 710/1412] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:30.200188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad206c-2e38-4f0c-bf01-1ad0b4bbfd60 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:30.200761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad206c-2e38-4f0c-bf01-1ad0b4bbfd60 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:30.200761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad206c-2e38-4f0c-bf01-1ad0b4bbfd60 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:30.202602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 703/1413] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:30.208718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c9709-2c1c-4699-9d05-bac20806b081 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:30.209263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c9709-2c1c-4699-9d05-bac20806b081 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:30.209263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c9709-2c1c-4699-9d05-bac20806b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:30.228431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c35c9709-2c1c-4699-9d05-bac20806b081 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:30.229746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c35c9709-2c1c-4699-9d05-bac20806b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:30.238706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 711/1414] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:30.404512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad206c-2e38-4f0c-bf01-1ad0b4bbfd60 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:30.421029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad206c-2e38-4f0c-bf01-1ad0b4bbfd60 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:30.427247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e0b22-2a03-4d8a-93f0-01bc4bdfa9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:30.427901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e0b22-2a03-4d8a-93f0-01bc4bdfa9c9 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:30.428178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e0b22-2a03-4d8a-93f0-01bc4bdfa9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:30.428447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e0b22-2a03-4d8a-93f0-01bc4bdfa9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:30.437446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e0b22-2a03-4d8a-93f0-01bc4bdfa9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:30.439102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e0b22-2a03-4d8a-93f0-01bc4bdfa9c9 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:30.451031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 704/1415] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:31.916326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e68a-0fa1-46eb-9db0-dbab0f8cb0ca None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:31.916956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e68a-0fa1-46eb-9db0-dbab0f8cb0ca None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:31.916956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16e68a-0fa1-46eb-9db0-dbab0f8cb0ca None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:31.918727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 712/1416] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:31.924766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e15f5b-5eaa-48d4-b9bf-69f410db3145 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:31.925517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e15f5b-5eaa-48d4-b9bf-69f410db3145 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:31.926468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e15f5b-5eaa-48d4-b9bf-69f410db3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:31.946575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-34e15f5b-5eaa-48d4-b9bf-69f410db3145 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:31.947970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-34e15f5b-5eaa-48d4-b9bf-69f410db3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:31.957908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 705/1417] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:32.114368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e68a-0fa1-46eb-9db0-dbab0f8cb0ca None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:32.133420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16e68a-0fa1-46eb-9db0-dbab0f8cb0ca None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:32.139858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bef1d7-4eec-4f56-ac8d-a36b2b0de398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:32.140580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bef1d7-4eec-4f56-ac8d-a36b2b0de398 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:32.140860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bef1d7-4eec-4f56-ac8d-a36b2b0de398 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:32.141135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bef1d7-4eec-4f56-ac8d-a36b2b0de398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:32.153643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bef1d7-4eec-4f56-ac8d-a36b2b0de398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:32.156538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bef1d7-4eec-4f56-ac8d-a36b2b0de398 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:32.172378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 713/1418] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:33.677891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc89f9-fa68-4ab7-8755-cc2fa71f3e0a None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:33.678550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc89f9-fa68-4ab7-8755-cc2fa71f3e0a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:33.678550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc89f9-fa68-4ab7-8755-cc2fa71f3e0a None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:33.680230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 706/1419] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:33.688217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a52cfa-3f73-4573-84eb-f778a59f585b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:33.688778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a52cfa-3f73-4573-84eb-f778a59f585b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:33.689038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a52cfa-3f73-4573-84eb-f778a59f585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:33.713247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-68a52cfa-3f73-4573-84eb-f778a59f585b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:33.714527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-68a52cfa-3f73-4573-84eb-f778a59f585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:33.722959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 714/1420] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:33.879220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc89f9-fa68-4ab7-8755-cc2fa71f3e0a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:33.897106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc89f9-fa68-4ab7-8755-cc2fa71f3e0a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:33.903133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c5055-4e0b-41ee-b197-adaef4e30fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:33.903799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c5055-4e0b-41ee-b197-adaef4e30fcd service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:33.904078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c5055-4e0b-41ee-b197-adaef4e30fcd service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:33.904351 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c5055-4e0b-41ee-b197-adaef4e30fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:33.914074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c5055-4e0b-41ee-b197-adaef4e30fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:33.916138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c5055-4e0b-41ee-b197-adaef4e30fcd service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:33.926565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 707/1421] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:35.406061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f50d-ce8f-486d-9ab4-f5dc0a026f39 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:35.406895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f50d-ce8f-486d-9ab4-f5dc0a026f39 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:35.406895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f50d-ce8f-486d-9ab4-f5dc0a026f39 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:35.409280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 715/1422] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:35.417632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf504f-2b96-4371-b450-0a77c7601206 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:35.418225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf504f-2b96-4371-b450-0a77c7601206 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:35.418346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf504f-2b96-4371-b450-0a77c7601206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:35.443150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c7cf504f-2b96-4371-b450-0a77c7601206 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:35.444406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c7cf504f-2b96-4371-b450-0a77c7601206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:35.454107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 708/1423] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:35.704840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f50d-ce8f-486d-9ab4-f5dc0a026f39 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:35.720961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f50d-ce8f-486d-9ab4-f5dc0a026f39 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:35.727528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a556-f039-46e3-9acc-017f8f346a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:35.728239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a556-f039-46e3-9acc-017f8f346a06 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:35.728523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a556-f039-46e3-9acc-017f8f346a06 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:35.728795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a556-f039-46e3-9acc-017f8f346a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:35.738403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a556-f039-46e3-9acc-017f8f346a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:35.740386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a556-f039-46e3-9acc-017f8f346a06 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:35.751729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 716/1424] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:37.289540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d809699-4847-4d01-9408-a051e51fadb8 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:37.290455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d809699-4847-4d01-9408-a051e51fadb8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:37.290455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d809699-4847-4d01-9408-a051e51fadb8 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:37.292215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 709/1425] 10.222.0.60 () {54 vars in 911 bytes} [Wed Nov 10 15:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:37.298559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809cb23-2329-4fa8-afb0-25aaf39f7969 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:37.299031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809cb23-2329-4fa8-afb0-25aaf39f7969 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:37.299171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809cb23-2329-4fa8-afb0-25aaf39f7969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:37.317193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2809cb23-2329-4fa8-afb0-25aaf39f7969 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:37.318407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2809cb23-2329-4fa8-afb0-25aaf39f7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:37.327700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 717/1426] 10.222.0.60 () {58 vars in 1008 bytes} [Wed Nov 10 15:48:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:37.482459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d809699-4847-4d01-9408-a051e51fadb8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:37.498789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d809699-4847-4d01-9408-a051e51fadb8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:37.504698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766134-ec85-4467-973e-98e4ddb5f7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:37.506305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766134-ec85-4467-973e-98e4ddb5f7a6 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:37.506305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766134-ec85-4467-973e-98e4ddb5f7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:37.506305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766134-ec85-4467-973e-98e4ddb5f7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:37.514871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766134-ec85-4467-973e-98e4ddb5f7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:37.516478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766134-ec85-4467-973e-98e4ddb5f7a6 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:37.526228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 710/1427] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:39.716372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cb810-bf2f-44e3-b9ef-575eb5e8b20d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:39.716971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cb810-bf2f-44e3-b9ef-575eb5e8b20d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:39.716971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cb810-bf2f-44e3-b9ef-575eb5e8b20d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:39.718855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 718/1428] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:39.725592 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c07eb-9055-4e58-aa55-856933f9d75a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:39.726048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c07eb-9055-4e58-aa55-856933f9d75a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:39.726221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c07eb-9055-4e58-aa55-856933f9d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:39.745462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c92c07eb-9055-4e58-aa55-856933f9d75a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:39.746738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c92c07eb-9055-4e58-aa55-856933f9d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:39.755157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 711/1429] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:39.797224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cb810-bf2f-44e3-b9ef-575eb5e8b20d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:39.809521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cb810-bf2f-44e3-b9ef-575eb5e8b20d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:39.813283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bedd580-2f86-4b8d-b2e5-4745107285c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:39.813919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedd580-2f86-4b8d-b2e5-4745107285c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:39.814226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedd580-2f86-4b8d-b2e5-4745107285c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:39.814533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bedd580-2f86-4b8d-b2e5-4745107285c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:39.824881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedd580-2f86-4b8d-b2e5-4745107285c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:39.826356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bedd580-2f86-4b8d-b2e5-4745107285c6 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:39.836256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 719/1430] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:42.632442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78ade-f8e4-45fd-9601-69239c5948a0 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:42.633022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78ade-f8e4-45fd-9601-69239c5948a0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:42.633330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78ade-f8e4-45fd-9601-69239c5948a0 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:42.636685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 712/1431] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:42 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:42.643119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c892df-4a90-4388-9918-c687ecc6dd65 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:42.643595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c892df-4a90-4388-9918-c687ecc6dd65 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:42.643985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c892df-4a90-4388-9918-c687ecc6dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:42.665484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-38c892df-4a90-4388-9918-c687ecc6dd65 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:42.666844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-38c892df-4a90-4388-9918-c687ecc6dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:42.677484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 720/1432] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:42.721919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f78ade-f8e4-45fd-9601-69239c5948a0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:42.732994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f78ade-f8e4-45fd-9601-69239c5948a0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:42.736614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ce3ae-9d27-438b-9aca-21d82d1db9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:42.737268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce3ae-9d27-438b-9aca-21d82d1db9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:42.737672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce3ae-9d27-438b-9aca-21d82d1db9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:42.737949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce3ae-9d27-438b-9aca-21d82d1db9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:42.747634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce3ae-9d27-438b-9aca-21d82d1db9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:42.749119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce3ae-9d27-438b-9aca-21d82d1db9f5 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:42.759321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 713/1433] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:45.450815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a68e-5244-4663-ac20-1c9017339661 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:45.451405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a68e-5244-4663-ac20-1c9017339661 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:45.451405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a68e-5244-4663-ac20-1c9017339661 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:45.453305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 721/1434] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:45.460145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360274c-e59c-478e-9288-7f7d43227bfc None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:45.460739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360274c-e59c-478e-9288-7f7d43227bfc None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:45.460739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360274c-e59c-478e-9288-7f7d43227bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:45.479363 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7360274c-e59c-478e-9288-7f7d43227bfc None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:45.480581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7360274c-e59c-478e-9288-7f7d43227bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:45.489489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 714/1435] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:45.536909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a68e-5244-4663-ac20-1c9017339661 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:45.549329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a68e-5244-4663-ac20-1c9017339661 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:45.553770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933d1d5-a560-4898-94bf-3e578cecd754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:45.554478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d1d5-a560-4898-94bf-3e578cecd754 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:45.554753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d1d5-a560-4898-94bf-3e578cecd754 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:45.555023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933d1d5-a560-4898-94bf-3e578cecd754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:45.564954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933d1d5-a560-4898-94bf-3e578cecd754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:45.566560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933d1d5-a560-4898-94bf-3e578cecd754 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:45.576570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 722/1436] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:48.054680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71927c-d7d1-4cb6-a252-91c1be3412b2 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:48.055465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71927c-d7d1-4cb6-a252-91c1be3412b2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:48.055465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71927c-d7d1-4cb6-a252-91c1be3412b2 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:48.056999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 715/1437] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:48.063042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23be4c-23c4-4e18-ad6e-f9cc591966c2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:48.063711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23be4c-23c4-4e18-ad6e-f9cc591966c2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:48.063711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23be4c-23c4-4e18-ad6e-f9cc591966c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:48.082805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4d23be4c-23c4-4e18-ad6e-f9cc591966c2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:48.084023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4d23be4c-23c4-4e18-ad6e-f9cc591966c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:48.092532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 723/1438] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:48.137515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71927c-d7d1-4cb6-a252-91c1be3412b2 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:48.151161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71927c-d7d1-4cb6-a252-91c1be3412b2 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:48.155109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c4d6d-a3ba-4de0-93da-2b382ed56d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:48.155748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c4d6d-a3ba-4de0-93da-2b382ed56d49 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:48.156039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c4d6d-a3ba-4de0-93da-2b382ed56d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:48.156312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c4d6d-a3ba-4de0-93da-2b382ed56d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:48.166517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c4d6d-a3ba-4de0-93da-2b382ed56d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:48.167948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c4d6d-a3ba-4de0-93da-2b382ed56d49 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:48.178326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 716/1439] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:50.606873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4d38-9858-489e-b874-207ac5bed5f3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:50.607442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4d38-9858-489e-b874-207ac5bed5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:50.607442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4d38-9858-489e-b874-207ac5bed5f3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:50.609176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 724/1440] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:50.615848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e5a6e-3750-47d5-8a93-fbf7ce2f1020 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:50.616338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e5a6e-3750-47d5-8a93-fbf7ce2f1020 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:50.616435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e5a6e-3750-47d5-8a93-fbf7ce2f1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:50.635177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-109e5a6e-3750-47d5-8a93-fbf7ce2f1020 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:50.636400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-109e5a6e-3750-47d5-8a93-fbf7ce2f1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:50.645314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 717/1441] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:50.688729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4d38-9858-489e-b874-207ac5bed5f3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:50.701239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4d38-9858-489e-b874-207ac5bed5f3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:50.705347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ae0cc-7721-4167-bb59-d8370371a547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:50.705989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae0cc-7721-4167-bb59-d8370371a547 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:50.706303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae0cc-7721-4167-bb59-d8370371a547 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:50.706583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae0cc-7721-4167-bb59-d8370371a547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:50.716508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ae0cc-7721-4167-bb59-d8370371a547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:50.717953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ae0cc-7721-4167-bb59-d8370371a547 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:50.728518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 725/1442] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:48:53.207777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d0e47-4cd1-475e-a8b4-53b0120562da None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:53.208395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d0e47-4cd1-475e-a8b4-53b0120562da None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:53.208395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d0e47-4cd1-475e-a8b4-53b0120562da None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:53.210336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 718/1443] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:53.217200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2196-38f9-4848-99bd-44d04e838cfc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:53.217721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2196-38f9-4848-99bd-44d04e838cfc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:53.217816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d2196-38f9-4848-99bd-44d04e838cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:53.236668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fe4d2196-38f9-4848-99bd-44d04e838cfc None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:53.238361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fe4d2196-38f9-4848-99bd-44d04e838cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:53.251174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 726/1444] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:53.294948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d0e47-4cd1-475e-a8b4-53b0120562da None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:53.306932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d0e47-4cd1-475e-a8b4-53b0120562da None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:53.310865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f2b9d-2e9c-47d9-b116-4bbc43825b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:53.311530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2b9d-2e9c-47d9-b116-4bbc43825b98 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:53.311799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2b9d-2e9c-47d9-b116-4bbc43825b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:53.312075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f2b9d-2e9c-47d9-b116-4bbc43825b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:53.322275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2b9d-2e9c-47d9-b116-4bbc43825b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:53.323749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f2b9d-2e9c-47d9-b116-4bbc43825b98 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:53.334412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 719/1445] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:48:55.838134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ea3bb-b951-490a-82fe-e386949a85a6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:55.839042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ea3bb-b951-490a-82fe-e386949a85a6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:55.839200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ea3bb-b951-490a-82fe-e386949a85a6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:55.841474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 727/1446] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:48:55.848865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3fe3-d7c9-4a4e-ba36-445c50f23b9e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:55.849550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3fe3-d7c9-4a4e-ba36-445c50f23b9e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:55.849550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3fe3-d7c9-4a4e-ba36-445c50f23b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:55.870034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-dbae3fe3-d7c9-4a4e-ba36-445c50f23b9e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:55.871399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-dbae3fe3-d7c9-4a4e-ba36-445c50f23b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:55.880879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 720/1447] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:48:55.924711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ea3bb-b951-490a-82fe-e386949a85a6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:55.936633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ea3bb-b951-490a-82fe-e386949a85a6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:55.940513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b840905-8053-4d01-9b9e-cbb9cdcb052a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:55.941547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840905-8053-4d01-9b9e-cbb9cdcb052a service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:55.941820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840905-8053-4d01-9b9e-cbb9cdcb052a service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:55.942106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b840905-8053-4d01-9b9e-cbb9cdcb052a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:55.952495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840905-8053-4d01-9b9e-cbb9cdcb052a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:55.954226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b840905-8053-4d01-9b9e-cbb9cdcb052a service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:55.965941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 728/1448] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:48:58.747548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66caf50-6453-41c6-a149-a8a24d1bfb44 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:58.748160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66caf50-6453-41c6-a149-a8a24d1bfb44 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:58.748160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66caf50-6453-41c6-a149-a8a24d1bfb44 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:58.749973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 721/1449] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:48:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:48:58.757183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71879f5-6fb1-4445-9879-7147b45e9423 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:58.757745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71879f5-6fb1-4445-9879-7147b45e9423 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:58.757745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71879f5-6fb1-4445-9879-7147b45e9423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:58.780598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c71879f5-6fb1-4445-9879-7147b45e9423 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:48:58.782344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c71879f5-6fb1-4445-9879-7147b45e9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:48:58.791540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 729/1450] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:48:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:48:58.840118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66caf50-6453-41c6-a149-a8a24d1bfb44 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:48:58.852481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66caf50-6453-41c6-a149-a8a24d1bfb44 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:48:58.856249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28fb03-5699-4afe-bd03-7605d20044b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:48:58.856920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28fb03-5699-4afe-bd03-7605d20044b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:48:58.857196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28fb03-5699-4afe-bd03-7605d20044b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:48:58.857466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28fb03-5699-4afe-bd03-7605d20044b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:48:58.868326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28fb03-5699-4afe-bd03-7605d20044b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:48:58.870076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28fb03-5699-4afe-bd03-7605d20044b9 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:48:58.881450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 722/1451] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:48:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:49:01.364783 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92199-e398-475e-aa43-bdef27f9eb8d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:01.365461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92199-e398-475e-aa43-bdef27f9eb8d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:01.365461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d92199-e398-475e-aa43-bdef27f9eb8d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:01.367541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 730/1452] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:01.374800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d44ff-b308-4d7c-9016-de47a9672aa2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:01.375770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d44ff-b308-4d7c-9016-de47a9672aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:01.375770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d44ff-b308-4d7c-9016-de47a9672aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:01.397011 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f25d44ff-b308-4d7c-9016-de47a9672aa2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:01.398483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f25d44ff-b308-4d7c-9016-de47a9672aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:01.407308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 723/1453] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:01.451124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92199-e398-475e-aa43-bdef27f9eb8d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:01.463408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d92199-e398-475e-aa43-bdef27f9eb8d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:01.467491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878369cd-142f-4457-ab2d-84938119236e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:01.468178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878369cd-142f-4457-ab2d-84938119236e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:01.468453 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878369cd-142f-4457-ab2d-84938119236e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:01.468720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878369cd-142f-4457-ab2d-84938119236e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:01.479858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878369cd-142f-4457-ab2d-84938119236e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:01.482057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878369cd-142f-4457-ab2d-84938119236e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:01.493920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 731/1454] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:49:04.160713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd34e6-f264-4d39-94a8-7ffee4f43f5f None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:04.161841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd34e6-f264-4d39-94a8-7ffee4f43f5f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:04.161841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd34e6-f264-4d39-94a8-7ffee4f43f5f None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:04.164286 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 724/1455] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:49:04.173121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce108-bb95-476a-aac1-4d5cee83d938 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:04.173894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce108-bb95-476a-aac1-4d5cee83d938 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:04.173894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce108-bb95-476a-aac1-4d5cee83d938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:04.196445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6ecce108-bb95-476a-aac1-4d5cee83d938 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:04.197737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6ecce108-bb95-476a-aac1-4d5cee83d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:04.208856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 732/1456] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:04.255133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd34e6-f264-4d39-94a8-7ffee4f43f5f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:04.268838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd34e6-f264-4d39-94a8-7ffee4f43f5f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:04.274616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443701f0-cf1a-4a05-83e5-64e6d4196c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:04.275773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443701f0-cf1a-4a05-83e5-64e6d4196c41 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:04.276249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443701f0-cf1a-4a05-83e5-64e6d4196c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:04.276736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443701f0-cf1a-4a05-83e5-64e6d4196c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:04.294563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443701f0-cf1a-4a05-83e5-64e6d4196c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:04.297372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443701f0-cf1a-4a05-83e5-64e6d4196c41 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:04.317354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 725/1457] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:49:25.403710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705caabd-c1aa-4886-8f4b-8ab1b1875a4e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:25.404697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705caabd-c1aa-4886-8f4b-8ab1b1875a4e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:25.404697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705caabd-c1aa-4886-8f4b-8ab1b1875a4e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:25.406891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 733/1458] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:25.416426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed564e7-964a-47f2-a6b2-5d65ce80fde1 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:25.417066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed564e7-964a-47f2-a6b2-5d65ce80fde1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:25.417066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed564e7-964a-47f2-a6b2-5d65ce80fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:25.438316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fed564e7-964a-47f2-a6b2-5d65ce80fde1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:25.439647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fed564e7-964a-47f2-a6b2-5d65ce80fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:25.448742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 726/1459] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:49:25.507433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f4ed-e882-4de6-b3f0-4c90aa91e4d3 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:25.507784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f4ed-e882-4de6-b3f0-4c90aa91e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:25.508106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f4ed-e882-4de6-b3f0-4c90aa91e4d3 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:25.510074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 734/1460] 10.222.0.60 () {54 vars in 962 bytes} [Wed Nov 10 15:49:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:25.516938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48c8f-14ab-468b-9247-89774e656ba4 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:25.517225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48c8f-14ab-468b-9247-89774e656ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:25.517514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48c8f-14ab-468b-9247-89774e656ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:25.538463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9cb48c8f-14ab-468b-9247-89774e656ba4 None None] MFA Rules not processed for user `06999fb0772947f584d5608ca26f9352`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:25.540053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9cb48c8f-14ab-468b-9247-89774e656ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:25.547483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 727/1461] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Nov 10 15:49:25 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:25.556336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801f4ed-e882-4de6-b3f0-4c90aa91e4d3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:25.568530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801f4ed-e882-4de6-b3f0-4c90aa91e4d3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:25.572946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0c9f0-b541-4caa-94ec-05f5e2ec285d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:25.574516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0c9f0-b541-4caa-94ec-05f5e2ec285d service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:25.574516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0c9f0-b541-4caa-94ec-05f5e2ec285d service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:25.574706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0c9f0-b541-4caa-94ec-05f5e2ec285d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:25.586396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0c9f0-b541-4caa-94ec-05f5e2ec285d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:25.588028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0c9f0-b541-4caa-94ec-05f5e2ec285d service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:25.599892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 735/1462] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:49:29.410438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4ac5-d720-4482-ac69-7d334af64e53 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:29.411399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4ac5-d720-4482-ac69-7d334af64e53 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:29.411399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4ac5-d720-4482-ac69-7d334af64e53 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:29.413695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 728/1463] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:29.426214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9da6-4076-4cea-ae86-e482ba168913 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:29.426908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9da6-4076-4cea-ae86-e482ba168913 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:29.427194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9da6-4076-4cea-ae86-e482ba168913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:29.458253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-afac9da6-4076-4cea-ae86-e482ba168913 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:29.460542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afac9da6-4076-4cea-ae86-e482ba168913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:29.471439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 736/1464] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:29.520371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b4ac5-d720-4482-ac69-7d334af64e53 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:29.543183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b4ac5-d720-4482-ac69-7d334af64e53 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:29.551580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f87f21-30a2-4ce7-8863-b84fce9ee18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:29.552779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87f21-30a2-4ce7-8863-b84fce9ee18f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:29.553247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87f21-30a2-4ce7-8863-b84fce9ee18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:29.553748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f87f21-30a2-4ce7-8863-b84fce9ee18f admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:29.555217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f87f21-30a2-4ce7-8863-b84fce9ee18f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:29.559069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f87f21-30a2-4ce7-8863-b84fce9ee18f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:29.589144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 729/1465] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Nov 10 15:49:29 2021] GET /identity/v3/projects => generated 2553 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:49:32.504831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd16e9-56a2-4699-b85e-6d6fbd043b89 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:32.505413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd16e9-56a2-4699-b85e-6d6fbd043b89 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:32.505413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd16e9-56a2-4699-b85e-6d6fbd043b89 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:32.507229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 737/1466] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:32.518555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce01a9-e902-48d4-a06d-d44b78b9e4cb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:32.519208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce01a9-e902-48d4-a06d-d44b78b9e4cb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:32.519342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce01a9-e902-48d4-a06d-d44b78b9e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:32.546524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-42ce01a9-e902-48d4-a06d-d44b78b9e4cb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:32.548617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-42ce01a9-e902-48d4-a06d-d44b78b9e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:32.562635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 730/1467] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:32.634895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd16e9-56a2-4699-b85e-6d6fbd043b89 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:32.652118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd16e9-56a2-4699-b85e-6d6fbd043b89 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:32.658776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdaae0-03f6-4974-946d-b0388fa35e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:32.659581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdaae0-03f6-4974-946d-b0388fa35e63 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:32.659890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdaae0-03f6-4974-946d-b0388fa35e63 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:32.660103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdaae0-03f6-4974-946d-b0388fa35e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:32.669896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdaae0-03f6-4974-946d-b0388fa35e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:32.672245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdaae0-03f6-4974-946d-b0388fa35e63 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:32.683889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 738/1468] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:49:35.466504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95be57-e6f2-44b3-94d9-4d5dfcf801c4 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:35.467405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95be57-e6f2-44b3-94d9-4d5dfcf801c4 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:35.467405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95be57-e6f2-44b3-94d9-4d5dfcf801c4 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:35.469501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 731/1469] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:49:35.478508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64da69b-e86e-49ea-8d1e-b65c7177c293 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:35.479538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64da69b-e86e-49ea-8d1e-b65c7177c293 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:35.479538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64da69b-e86e-49ea-8d1e-b65c7177c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:35.503392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c64da69b-e86e-49ea-8d1e-b65c7177c293 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:35.505708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c64da69b-e86e-49ea-8d1e-b65c7177c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:35.520366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 739/1470] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:35.564866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95be57-e6f2-44b3-94d9-4d5dfcf801c4 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:35.578400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95be57-e6f2-44b3-94d9-4d5dfcf801c4 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:35.585639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a701a9-ddc9-4a1b-aa25-dc1fc2e56317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:35.586843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a701a9-ddc9-4a1b-aa25-dc1fc2e56317 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:35.586989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a701a9-ddc9-4a1b-aa25-dc1fc2e56317 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:35.587390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a701a9-ddc9-4a1b-aa25-dc1fc2e56317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:35.600786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a701a9-ddc9-4a1b-aa25-dc1fc2e56317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:35.602320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a701a9-ddc9-4a1b-aa25-dc1fc2e56317 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:35.614494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 732/1471] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:49:38.176887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e1fb4-a6a5-4d5a-979c-4a6dd63824b2 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:38.177589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e1fb4-a6a5-4d5a-979c-4a6dd63824b2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:38.177932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e1fb4-a6a5-4d5a-979c-4a6dd63824b2 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:38.181387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 740/1472] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:38 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:38.188375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ed52-111c-4c9e-9ff2-1c49c0c9782d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:38.188976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ed52-111c-4c9e-9ff2-1c49c0c9782d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:38.188976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ed52-111c-4c9e-9ff2-1c49c0c9782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:38.209565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ed22ed52-111c-4c9e-9ff2-1c49c0c9782d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:38.211102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ed22ed52-111c-4c9e-9ff2-1c49c0c9782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:38.224885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 733/1473] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:38.275506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e1fb4-a6a5-4d5a-979c-4a6dd63824b2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:38.288984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e1fb4-a6a5-4d5a-979c-4a6dd63824b2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:38.293460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25041d-5efd-49ca-b04c-394d255fb679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:38.294113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25041d-5efd-49ca-b04c-394d255fb679 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:38.294443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25041d-5efd-49ca-b04c-394d255fb679 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:38.294720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25041d-5efd-49ca-b04c-394d255fb679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:38.306636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25041d-5efd-49ca-b04c-394d255fb679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:38.308286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25041d-5efd-49ca-b04c-394d255fb679 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:38.323263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 741/1474] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:49:40.943887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45890-3dcb-45f7-a1ae-3f54d11239dd None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:40.944553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45890-3dcb-45f7-a1ae-3f54d11239dd None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:40.944553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45890-3dcb-45f7-a1ae-3f54d11239dd None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:40.946388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 734/1475] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:40.954853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea707ad-5e04-47e8-acab-14a1e3cd850f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:40.955451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea707ad-5e04-47e8-acab-14a1e3cd850f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:40.955825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea707ad-5e04-47e8-acab-14a1e3cd850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:40.984666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8ea707ad-5e04-47e8-acab-14a1e3cd850f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:40.985914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8ea707ad-5e04-47e8-acab-14a1e3cd850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:40.994932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 742/1476] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:41.044804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45890-3dcb-45f7-a1ae-3f54d11239dd None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:41.058002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45890-3dcb-45f7-a1ae-3f54d11239dd None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:41.063014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b153b9a-8d7c-447a-aefa-75adccf440a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:41.063846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b153b9a-8d7c-447a-aefa-75adccf440a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:41.064154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b153b9a-8d7c-447a-aefa-75adccf440a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:41.064545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b153b9a-8d7c-447a-aefa-75adccf440a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:41.076512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b153b9a-8d7c-447a-aefa-75adccf440a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:41.078183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b153b9a-8d7c-447a-aefa-75adccf440a2 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:41.089894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 735/1477] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:49:44.174385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca2cd-eefa-4909-b4b9-51217ec37819 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:44.175496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca2cd-eefa-4909-b4b9-51217ec37819 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:44.175496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca2cd-eefa-4909-b4b9-51217ec37819 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:44.177553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 743/1478] 10.222.0.60 () {54 vars in 926 bytes} [Wed Nov 10 15:49:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:49:44.185437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674334-5a13-4239-ad98-3e677e9c3aff None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:44.186364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674334-5a13-4239-ad98-3e677e9c3aff None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:44.186364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674334-5a13-4239-ad98-3e677e9c3aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:44.207126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bc674334-5a13-4239-ad98-3e677e9c3aff None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:49:44.208402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bc674334-5a13-4239-ad98-3e677e9c3aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:49:44.220104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 736/1479] 10.222.0.60 () {58 vars in 1023 bytes} [Wed Nov 10 15:49:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:49:44.267898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca2cd-eefa-4909-b4b9-51217ec37819 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:49:44.281287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca2cd-eefa-4909-b4b9-51217ec37819 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:49:44.286527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7767d-6ef5-4167-b929-a86c92f022da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:49:44.287217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7767d-6ef5-4167-b929-a86c92f022da service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:49:44.287492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7767d-6ef5-4167-b929-a86c92f022da service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:49:44.287763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7767d-6ef5-4167-b929-a86c92f022da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:49:44.300104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7767d-6ef5-4167-b929-a86c92f022da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:49:44.301851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7767d-6ef5-4167-b929-a86c92f022da service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:49:44.313458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 744/1480] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:49:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:51:10.792188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:10.792855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:10.792855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:10.811803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:51:10.813038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:51:10.821711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 737/1481] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:51:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:51:10.831076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:10.831847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:10.831847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:10.857336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:51:10.859062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:51:10.868716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 745/1482] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:51:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:51:10.873575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:10.883755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8434d-ae6e-439f-907d-e4e376a9e06e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:10.888718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:10.889411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:10.889699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:10.889971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:10.890808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:51:10.891151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:10.892825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:10.907136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 738/1483] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:51:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:51:10.916107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:10.926187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e981-43bc-4dac-b31b-728859c834df None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:10.930768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:10.931431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:10.931706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:10.931975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:10.932697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:10.934640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:10.974799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 746/1484] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:51:10 2021] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:51:10.978819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:10.989110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048667c-ce2f-4c72-bc51-8ee904c810d8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.049019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.049690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.049885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.050152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.050900 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.052861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.074521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 739/1485] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:51:10 2021] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:51:11.080619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:11.092304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482351b-6a03-469c-9fc8-3f7f1ce59722 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.098536 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.099218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.100017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.100017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.100498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.102185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.117832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 747/1486] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:51:11 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:51:11.122091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:11.132493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2e75-4d8e-40c5-9a20-8cc56f35dd14 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.137413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b995-7f3c-4aa4-a33e-903d88820cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.138093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b995-7f3c-4aa4-a33e-903d88820cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.138403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b995-7f3c-4aa4-a33e-903d88820cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.138676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b995-7f3c-4aa4-a33e-903d88820cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.139436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b995-7f3c-4aa4-a33e-903d88820cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.141050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b995-7f3c-4aa4-a33e-903d88820cc9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.155041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 740/1487] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:51:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:51:11.160246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:11.171717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163b0cf-7035-4ac4-aa81-103130c4641e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.177794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.178748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.179034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.179311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] PATH_INFO: `/v3/projects/ea0c92cbe0394f28bf5dd4b44ae0506b/users/3396a881bb0c4646931c0710ad3ca89d/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.196968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0c92cbe0394f28bf5dd4b44ae0506b, user_id=3396a881bb0c4646931c0710ad3ca89d, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.199751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.218198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 748/1488] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:51:11 2021] PUT /identity/v3/projects/ea0c92cbe0394f28bf5dd4b44ae0506b/users/3396a881bb0c4646931c0710ad3ca89d/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:51:11.231148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441c638-99ce-4a65-aa84-337922b9c2b2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.231421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441c638-99ce-4a65-aa84-337922b9c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.231687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441c638-99ce-4a65-aa84-337922b9c2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.261567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c441c638-99ce-4a65-aa84-337922b9c2b2 None None] MFA Rules not processed for user `3396a881bb0c4646931c0710ad3ca89d`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:51:11.262993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c441c638-99ce-4a65-aa84-337922b9c2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:51:11.340579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 741/1489] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:51:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:51:11.355770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:11.438280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc03f0-d157-4091-b2f0-0b3f8ba8c741 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.444702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.445629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.445629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.446387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.455343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.456996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.467881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 749/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:51:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:51:11.541213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da553a-9b52-4eec-b2fb-b251d426ed03 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.541496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da553a-9b52-4eec-b2fb-b251d426ed03 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.541787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da553a-9b52-4eec-b2fb-b251d426ed03 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.543753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 742/1491] 10.222.0.60 () {52 vars in 829 bytes} [Wed Nov 10 15:51:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:51:11.548057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:11.624403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461da3-6ab9-4b3a-9e4f-e360afa4f0dd service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.630299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.631201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.631489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.631762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] PATH_INFO: `/v3/users/3396a881bb0c4646931c0710ad3ca89d` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.633085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3396a881bb0c4646931c0710ad3ca89d)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.634123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:51:11.634123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:51:11.634123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:51:11.635391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.709575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3396a881bb0c4646931c0710ad3ca89d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:11.710430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3396a881bb0c4646931c0710ad3ca89d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:11.711324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3396a881bb0c4646931c0710ad3ca89d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:11.723235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3396a881bb0c4646931c0710ad3ca89d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:11.748089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3396a881bb0c4646931c0710ad3ca89d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:11.768441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 750/1492] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:51:11 2021] DELETE /identity/v3/users/3396a881bb0c4646931c0710ad3ca89d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:51:11.773350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.773642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.773931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.792846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:51:11.794066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:51:11.857365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 743/1493] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:51:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:51:11.869513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:11.873053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:51:11.940359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b677b3f-bfa6-43c3-838b-4699414ee4f3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:11.947127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915481-3089-4ded-9e8d-90c906c5ce29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:11.948260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915481-3089-4ded-9e8d-90c906c5ce29 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:11.948737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915481-3089-4ded-9e8d-90c906c5ce29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:11.949214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915481-3089-4ded-9e8d-90c906c5ce29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:11.966869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915481-3089-4ded-9e8d-90c906c5ce29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:11.969363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915481-3089-4ded-9e8d-90c906c5ce29 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:11.987671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 751/1494] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:51:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:51:12.391912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:51:12.394892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:51:12.416666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a7725-d735-4a26-b5ea-c8134814c27b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:51:12.424907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:51:12.425839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:51:12.426138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:51:12.426417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] PATH_INFO: `/v3/projects/ea0c92cbe0394f28bf5dd4b44ae0506b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:51:12.427909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0c92cbe0394f28bf5dd4b44ae0506b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:51:12.433117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:51:12.433117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:51:12.433117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:51:12.435043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:51:12.524202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0c92cbe0394f28bf5dd4b44ae0506b', 'request_id': 'req-5254ff65-6b39-425b-8a04-0e209dea31af'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:12.536606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0c92cbe0394f28bf5dd4b44ae0506b', 'request_id': 'req-5254ff65-6b39-425b-8a04-0e209dea31af'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:12.544505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0c92cbe0394f28bf5dd4b44ae0506b', 'request_id': 'req-5254ff65-6b39-425b-8a04-0e209dea31af'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:12.566798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] The token cache is being invalidate because project ea0c92cbe0394f28bf5dd4b44ae0506b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:51:12.567088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:12.567798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5254ff65-6b39-425b-8a04-0e209dea31af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:51:12.569583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 744/1495] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:51:12 2021] DELETE /identity/v3/projects/ea0c92cbe0394f28bf5dd4b44ae0506b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:52:42.196315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f81a88-9f2f-4cf2-9447-7f1c3f683773 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:42.197181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f81a88-9f2f-4cf2-9447-7f1c3f683773 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:42.197181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f81a88-9f2f-4cf2-9447-7f1c3f683773 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:42.199539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 752/1496] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 10 15:52:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:52:42.205831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:42.206498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:42.206498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:42.229174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:52:42.230459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:42.268805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22aa23-722b-47de-a7a6-dc6251d4d561 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:42.269172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22aa23-722b-47de-a7a6-dc6251d4d561 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:42.269920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22aa23-722b-47de-a7a6-dc6251d4d561 None None] PATH_INFO: `/v3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:42.271875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 753/1497] 10.222.0.70 () {54 vars in 925 bytes} [Wed Nov 10 15:52:42 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:52:42.281100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5af1c-e836-49a9-bbda-3fd9483f820f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:42.281655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5af1c-e836-49a9-bbda-3fd9483f820f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:42.282223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5af1c-e836-49a9-bbda-3fd9483f820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:42.304091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 745/1498] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 10 15:52:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:52:42.312766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-79b5af1c-e836-49a9-bbda-3fd9483f820f None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:52:42.315733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-79b5af1c-e836-49a9-bbda-3fd9483f820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:42.403802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 754/1499] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Nov 10 15:52:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:52:42.473344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:52:42.474777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:42.565964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4f76f-19da-4f17-9029-59fcb64da5e6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:52:42.572441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a41ad-46f2-444d-a7bf-055511177c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:52:42.573147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a41ad-46f2-444d-a7bf-055511177c21 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:42.573426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a41ad-46f2-444d-a7bf-055511177c21 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:42.573697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a41ad-46f2-444d-a7bf-055511177c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:42.583754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a41ad-46f2-444d-a7bf-055511177c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:52:42.585408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a41ad-46f2-444d-a7bf-055511177c21 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:52:42.596968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 746/1500] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:52:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:52:44.163612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed33b6-51f9-4f22-b0b4-e9b76713375a None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:44.164243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed33b6-51f9-4f22-b0b4-e9b76713375a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:44.164243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed33b6-51f9-4f22-b0b4-e9b76713375a None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:44.166413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 755/1501] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 10 15:52:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:52:44.173030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7da9-508b-474c-a9fe-367df5dfa921 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:44.173850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7da9-508b-474c-a9fe-367df5dfa921 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:44.174132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7da9-508b-474c-a9fe-367df5dfa921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:44.195509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-6a8b7da9-508b-474c-a9fe-367df5dfa921 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:52:44.196765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6a8b7da9-508b-474c-a9fe-367df5dfa921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:44.205792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 747/1502] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 10 15:52:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:52:44.374048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed33b6-51f9-4f22-b0b4-e9b76713375a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:52:44.390810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed33b6-51f9-4f22-b0b4-e9b76713375a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:52:44.397976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15682769-31c9-4138-9f34-c76e12c02ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:52:44.398567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682769-31c9-4138-9f34-c76e12c02ddd service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:44.398840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682769-31c9-4138-9f34-c76e12c02ddd service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:44.399112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682769-31c9-4138-9f34-c76e12c02ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:44.409879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15682769-31c9-4138-9f34-c76e12c02ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:52:44.411592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15682769-31c9-4138-9f34-c76e12c02ddd service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:52:44.423608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 756/1503] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:52:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:52:46.226598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38962b2b-a954-4b99-93a6-0b6f3426be52 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:46.227413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38962b2b-a954-4b99-93a6-0b6f3426be52 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:46.227413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38962b2b-a954-4b99-93a6-0b6f3426be52 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:46.229170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 748/1504] 10.222.0.60 () {54 vars in 960 bytes} [Wed Nov 10 15:52:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:52:46.237493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01891ee9-41ad-4709-b4f0-200bfaeec039 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:46.238207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01891ee9-41ad-4709-b4f0-200bfaeec039 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:46.238574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01891ee9-41ad-4709-b4f0-200bfaeec039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:46.260454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-01891ee9-41ad-4709-b4f0-200bfaeec039 None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:52:46.261840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-01891ee9-41ad-4709-b4f0-200bfaeec039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:46.271708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 757/1505] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Nov 10 15:52:46 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:52:46.280238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38962b2b-a954-4b99-93a6-0b6f3426be52 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:52:46.296310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38962b2b-a954-4b99-93a6-0b6f3426be52 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:52:46.302184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54c5fb-5840-4fa8-a00c-cd9b46263683 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:52:46.302867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54c5fb-5840-4fa8-a00c-cd9b46263683 service placement] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:46.303165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54c5fb-5840-4fa8-a00c-cd9b46263683 service placement] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:46.303448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54c5fb-5840-4fa8-a00c-cd9b46263683 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:46.313221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54c5fb-5840-4fa8-a00c-cd9b46263683 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:52:46.315025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54c5fb-5840-4fa8-a00c-cd9b46263683 service placement] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:52:46.326683 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 749/1506] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:52:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:52:56.448893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1abbdd-1a9a-4d57-837d-b290df5343c5 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:56.449864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1abbdd-1a9a-4d57-837d-b290df5343c5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:56.449864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1abbdd-1a9a-4d57-837d-b290df5343c5 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:56.451897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 758/1507] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 10 15:52:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:52:56.458554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa91acc-4c58-4d36-b438-a9af2bbcd1cf None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:56.459398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa91acc-4c58-4d36-b438-a9af2bbcd1cf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:56.459398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa91acc-4c58-4d36-b438-a9af2bbcd1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:56.484002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-baa91acc-4c58-4d36-b438-a9af2bbcd1cf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:52:56.485322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-baa91acc-4c58-4d36-b438-a9af2bbcd1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:56.494768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 750/1508] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 10 15:52:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:52:56.655538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1abbdd-1a9a-4d57-837d-b290df5343c5 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:52:56.671139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1abbdd-1a9a-4d57-837d-b290df5343c5 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:52:56.677787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83e17-a82d-4315-8f55-e4fd6d46d589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:52:56.678515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83e17-a82d-4315-8f55-e4fd6d46d589 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:56.678800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83e17-a82d-4315-8f55-e4fd6d46d589 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:56.679077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83e17-a82d-4315-8f55-e4fd6d46d589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:56.689038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc83e17-a82d-4315-8f55-e4fd6d46d589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:52:56.690767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc83e17-a82d-4315-8f55-e4fd6d46d589 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:52:56.701887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 759/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:52:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:52:58.241556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8923-78df-44f2-80d0-c3af69e248bb None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:58.242466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8923-78df-44f2-80d0-c3af69e248bb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:58.242466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8923-78df-44f2-80d0-c3af69e248bb None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:58.244717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 751/1510] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 10 15:52:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:52:58.251765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0dbf-e201-4103-a4f1-05413448916d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:58.252547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0dbf-e201-4103-a4f1-05413448916d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:58.252719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0dbf-e201-4103-a4f1-05413448916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:58.273545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-009b0dbf-e201-4103-a4f1-05413448916d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:52:58.274892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-009b0dbf-e201-4103-a4f1-05413448916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:52:58.283313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 760/1511] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 10 15:52:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:52:58.453379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8923-78df-44f2-80d0-c3af69e248bb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:52:58.470811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8923-78df-44f2-80d0-c3af69e248bb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:52:58.477208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68dc0-214a-48b8-99b0-7aec891a4d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:52:58.477916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68dc0-214a-48b8-99b0-7aec891a4d97 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:52:58.478238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68dc0-214a-48b8-99b0-7aec891a4d97 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:52:58.478542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68dc0-214a-48b8-99b0-7aec891a4d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:52:58.489320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68dc0-214a-48b8-99b0-7aec891a4d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:52:58.491108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68dc0-214a-48b8-99b0-7aec891a4d97 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:52:58.503056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 752/1512] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:52:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:53:02.988278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19a3a-9aac-4b55-9a95-5561d6cae2a6 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:02.988910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19a3a-9aac-4b55-9a95-5561d6cae2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:02.988910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19a3a-9aac-4b55-9a95-5561d6cae2a6 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:02.990753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 761/1513] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 10 15:53:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:53:03.003821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7411f-38c3-4fbc-8c39-3be73321848c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:03.004474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7411f-38c3-4fbc-8c39-3be73321848c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:03.004969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7411f-38c3-4fbc-8c39-3be73321848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:03.036507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ffc7411f-38c3-4fbc-8c39-3be73321848c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:53:03.038919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ffc7411f-38c3-4fbc-8c39-3be73321848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:03.053370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 753/1514] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 10 15:53:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:53:03.120069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19a3a-9aac-4b55-9a95-5561d6cae2a6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:53:03.122244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a4d19a3a-9aac-4b55-9a95-5561d6cae2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:03.206506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19a3a-9aac-4b55-9a95-5561d6cae2a6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:53:03.211316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893a8f5-424c-482a-b8fa-e7754d70b824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:53:03.211991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a8f5-424c-482a-b8fa-e7754d70b824 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:03.212268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a8f5-424c-482a-b8fa-e7754d70b824 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:03.212537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a8f5-424c-482a-b8fa-e7754d70b824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:03.224358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893a8f5-424c-482a-b8fa-e7754d70b824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:53:03.226451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893a8f5-424c-482a-b8fa-e7754d70b824 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:53:03.238732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 762/1515] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:53:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:53:05.776892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d24fe6-af1e-4206-a027-ea7d153d39ef None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:05.777522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d24fe6-af1e-4206-a027-ea7d153d39ef None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:05.777522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d24fe6-af1e-4206-a027-ea7d153d39ef None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:05.779369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 754/1516] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 10 15:53:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:53:05.786492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147372a1-06ac-4dec-9fa0-1a06b3e30f8a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:05.787677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147372a1-06ac-4dec-9fa0-1a06b3e30f8a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:05.787677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147372a1-06ac-4dec-9fa0-1a06b3e30f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:05.809658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-147372a1-06ac-4dec-9fa0-1a06b3e30f8a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:53:05.811931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-147372a1-06ac-4dec-9fa0-1a06b3e30f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:05.826295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 763/1517] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 10 15:53:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:53:05.869305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d24fe6-af1e-4206-a027-ea7d153d39ef None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:53:05.871490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-29d24fe6-af1e-4206-a027-ea7d153d39ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:05.886972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d24fe6-af1e-4206-a027-ea7d153d39ef None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:53:05.891730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347550f-0149-4d2b-829a-5f0c5ea7662f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:53:05.892757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347550f-0149-4d2b-829a-5f0c5ea7662f service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:05.893137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347550f-0149-4d2b-829a-5f0c5ea7662f service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:05.893529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347550f-0149-4d2b-829a-5f0c5ea7662f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:05.905057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347550f-0149-4d2b-829a-5f0c5ea7662f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:53:05.907150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347550f-0149-4d2b-829a-5f0c5ea7662f service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:53:05.924048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 755/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:53:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:53:10.193192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127ccb-242d-45fe-8a5c-6bde865d47a7 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:10.193778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127ccb-242d-45fe-8a5c-6bde865d47a7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:10.193778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127ccb-242d-45fe-8a5c-6bde865d47a7 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:10.195629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 10 15:53:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:53:10.202885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920080e2-bcf5-40fc-89c5-71c8a9820a7f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:10.203802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920080e2-bcf5-40fc-89c5-71c8a9820a7f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:10.203982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920080e2-bcf5-40fc-89c5-71c8a9820a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:10.227385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-920080e2-bcf5-40fc-89c5-71c8a9820a7f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:53:10.228836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-920080e2-bcf5-40fc-89c5-71c8a9820a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:10.238783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 10 15:53:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:53:10.294023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127ccb-242d-45fe-8a5c-6bde865d47a7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:53:10.295908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-59127ccb-242d-45fe-8a5c-6bde865d47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:10.363101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127ccb-242d-45fe-8a5c-6bde865d47a7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:53:10.367481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48abd-79de-421b-99d7-e7d0f27ddf89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:53:10.368185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48abd-79de-421b-99d7-e7d0f27ddf89 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:10.368468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48abd-79de-421b-99d7-e7d0f27ddf89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:10.368738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48abd-79de-421b-99d7-e7d0f27ddf89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:10.380062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48abd-79de-421b-99d7-e7d0f27ddf89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:53:10.381627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48abd-79de-421b-99d7-e7d0f27ddf89 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:53:10.393969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 765/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:53:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:53:12.845438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f577c-18f6-4f07-af8a-00578b2ad763 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:12.846097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f577c-18f6-4f07-af8a-00578b2ad763 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:12.846097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f577c-18f6-4f07-af8a-00578b2ad763 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:12.847840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 10 15:53:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:53:12.857755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e51fa-123c-44a8-b89c-8f1b41468175 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:12.858384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e51fa-123c-44a8-b89c-8f1b41468175 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:12.858384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e51fa-123c-44a8-b89c-8f1b41468175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:12.878945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-490e51fa-123c-44a8-b89c-8f1b41468175 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:53:12.880374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-490e51fa-123c-44a8-b89c-8f1b41468175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:12.889215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 10 15:53:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:53:12.948022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9213-5972-459e-824b-4dc8fb3c2ab5 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:12.948330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9213-5972-459e-824b-4dc8fb3c2ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:12.948694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9213-5972-459e-824b-4dc8fb3c2ab5 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:12.950717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 758/1524] 10.222.0.60 () {54 vars in 962 bytes} [Wed Nov 10 15:53:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:53:12.957965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34e65d-1175-48e0-bbe3-129aea50c8e2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:12.958493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34e65d-1175-48e0-bbe3-129aea50c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:12.958999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34e65d-1175-48e0-bbe3-129aea50c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:12.990534 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0e34e65d-1175-48e0-bbe3-129aea50c8e2 None None] MFA Rules not processed for user `f74dc52500784e41bce60a945035ab74`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:53:12.992889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0e34e65d-1175-48e0-bbe3-129aea50c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:53:13.004364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 767/1525] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Nov 10 15:53:12 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:53:13.018501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c9213-5972-459e-824b-4dc8fb3c2ab5 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:53:13.030667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c9213-5972-459e-824b-4dc8fb3c2ab5 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:53:13.034911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad13716-d762-4363-9792-f2f415fe2735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:53:13.035710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13716-d762-4363-9792-f2f415fe2735 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:53:13.036037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13716-d762-4363-9792-f2f415fe2735 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:53:13.036383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13716-d762-4363-9792-f2f415fe2735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:53:13.047975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad13716-d762-4363-9792-f2f415fe2735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:53:13.049650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad13716-d762-4363-9792-f2f415fe2735 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:53:13.061625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 759/1526] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:53:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:37.063323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.064749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.064749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.089515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.090801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.103931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 768/1527] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.113117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451900-acc3-4571-b8e4-d3378489a063 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.113702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451900-acc3-4571-b8e4-d3378489a063 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.113702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451900-acc3-4571-b8e4-d3378489a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.138828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fa451900-acc3-4571-b8e4-d3378489a063 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.140227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fa451900-acc3-4571-b8e4-d3378489a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.153069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 760/1528] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.158277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.172060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab9875-b815-40a1-b3af-da9ccf26d817 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.180645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440b56-a061-4883-80bd-20d81cb2684b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.180977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440b56-a061-4883-80bd-20d81cb2684b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.181198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440b56-a061-4883-80bd-20d81cb2684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.181764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.182477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.182760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.185043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.185836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.186148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.187932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a230718-4c79-443b-ae8c-aa46b9e07de4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.208733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-64440b56-a061-4883-80bd-20d81cb2684b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.209939 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-64440b56-a061-4883-80bd-20d81cb2684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.223277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 769/1529] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.224669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872ee88-1062-4d1a-b3d3-691bf443ac76 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.224951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872ee88-1062-4d1a-b3d3-691bf443ac76 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.225226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872ee88-1062-4d1a-b3d3-691bf443ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.237454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 761/1530] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:37.237454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8315-63fe-407d-9657-a91189de6a7a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.237454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8315-63fe-407d-9657-a91189de6a7a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.237454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8315-63fe-407d-9657-a91189de6a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.256042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5872ee88-1062-4d1a-b3d3-691bf443ac76 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.257434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5872ee88-1062-4d1a-b3d3-691bf443ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.259991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-202d8315-63fe-407d-9657-a91189de6a7a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.261497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-202d8315-63fe-407d-9657-a91189de6a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.266068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 770/1531] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.269814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c94ef-6134-44e9-8bfe-a0b388f037f0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.270109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c94ef-6134-44e9-8bfe-a0b388f037f0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.270419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c94ef-6134-44e9-8bfe-a0b388f037f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.271893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 762/1532] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.273390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.273678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.273953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.292672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.292932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-865c94ef-6134-44e9-8bfe-a0b388f037f0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.293911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-865c94ef-6134-44e9-8bfe-a0b388f037f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.294060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.301942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 763/1533] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.302250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 771/1534] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.302821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.304254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f03d-a935-43ea-8747-c2e0b21598d6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.304770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f03d-a935-43ea-8747-c2e0b21598d6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.305267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f03d-a935-43ea-8747-c2e0b21598d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.314357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c8b36-d648-428e-b0c3-c6eeeece46d7 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.319885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1263c8-e6cd-4b98-a267-16154a3cfcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.320556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1263c8-e6cd-4b98-a267-16154a3cfcfc admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.320837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1263c8-e6cd-4b98-a267-16154a3cfcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.321104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1263c8-e6cd-4b98-a267-16154a3cfcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.321819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1263c8-e6cd-4b98-a267-16154a3cfcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.323817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1263c8-e6cd-4b98-a267-16154a3cfcfc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.326923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1df1f03d-a935-43ea-8747-c2e0b21598d6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.328276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1df1f03d-a935-43ea-8747-c2e0b21598d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.336629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 772/1535] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.337878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176d13-fbe8-4b46-a197-677616a6680c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.338194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176d13-fbe8-4b46-a197-677616a6680c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.338489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176d13-fbe8-4b46-a197-677616a6680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.358263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 764/1536] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.363674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc7f5-0e18-4e4d-b681-cb95ca3bc4e9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.363970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ad176d13-fbe8-4b46-a197-677616a6680c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.364129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc7f5-0e18-4e4d-b681-cb95ca3bc4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.364247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc7f5-0e18-4e4d-b681-cb95ca3bc4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.365172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ad176d13-fbe8-4b46-a197-677616a6680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.383483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7c3dc7f5-0e18-4e4d-b681-cb95ca3bc4e9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.384694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7c3dc7f5-0e18-4e4d-b681-cb95ca3bc4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.425881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 773/1537] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.427393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451d40-ee93-4f89-bd39-01066ac2b8d6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.427755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451d40-ee93-4f89-bd39-01066ac2b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.428102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451d40-ee93-4f89-bd39-01066ac2b8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.446563 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8a451d40-ee93-4f89-bd39-01066ac2b8d6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.446809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 765/1538] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.448181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48fed-e266-4201-8111-e3ed95684658 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.448466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48fed-e266-4201-8111-e3ed95684658 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.448770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48fed-e266-4201-8111-e3ed95684658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.451559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8a451d40-ee93-4f89-bd39-01066ac2b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.463443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 774/1539] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.465234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cd7e6-902b-43d0-a961-24fd5736c303 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.465526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cd7e6-902b-43d0-a961-24fd5736c303 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.465806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cd7e6-902b-43d0-a961-24fd5736c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.470944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-19c48fed-e266-4201-8111-e3ed95684658 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.472162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-19c48fed-e266-4201-8111-e3ed95684658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.485154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 766/1540] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.485465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-096cd7e6-902b-43d0-a961-24fd5736c303 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.486525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.486806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-096cd7e6-902b-43d0-a961-24fd5736c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.486922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.487134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.496432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 775/1541] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.497997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.498331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.498653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.507616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.508827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.517409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 767/1542] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.518220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.518353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.519476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.528309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6cf17-8755-461f-9d3e-4fc4d7762f32 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.532414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 776/1543] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.532414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.534047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f7f6a-a2fe-408c-ab32-92408a642691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.534775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f7f6a-a2fe-408c-ab32-92408a642691 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.535377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f7f6a-a2fe-408c-ab32-92408a642691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.535654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f7f6a-a2fe-408c-ab32-92408a642691 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.536437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f7f6a-a2fe-408c-ab32-92408a642691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.538424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f7f6a-a2fe-408c-ab32-92408a642691 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.540579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b3e48-d91c-42cc-8f38-f2ee67a90dfb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.546098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.546914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.547191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.547466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.548254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.548535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.550226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.561791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 768/1544] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.563375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.563669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.564249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.569667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 777/1545] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.571220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.584017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:37.584392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41fdc-57cb-454c-8e87-efbfab6f916e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.585279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:37.590200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.590872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.591142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.591456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.592230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.592536 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.593458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 769/1546] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:37.594340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.594482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.604329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cee53-2ea6-410f-b2a9-e62633a4a0b9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.608510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 778/1547] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.609731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.617352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.618198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.618344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.618622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.619515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.619829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.620748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f250-9c1b-4849-bdc1-ac468a13d7a8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.621492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.626905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.627587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.627865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.628190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.628909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.629213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.630911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.641546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 770/1548] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.641546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.650904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 779/1549] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.650904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.651203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b960a-bd70-416b-88da-3540cad9162b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.651203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.651400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.651677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.651960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.652825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.653217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.654994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86532320-063b-4e8f-bae7-c547359294d5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.655738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.660371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.661040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.661321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.661592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.662382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.662690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.664297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.669636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 771/1550] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.670549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.677399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 780/1551] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.678513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.681696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24236-a788-421b-8da4-a3b283c3c93c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.686674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.687416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.687661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.688111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.688407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c812-8f27-4fef-ab0b-80b1ea6ee399 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.688867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.690536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.693194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.693855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.694139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.694449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.695172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.697087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.700821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 772/1552] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:37.701623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.711729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97be18-8e70-4b83-af12-253377de325b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.717121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.717779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.718184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.718584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.719358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:37.719666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.721287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.724856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 781/1553] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.725680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.741112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 773/1554] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:37.741112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.744639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1c992-7944-4632-a28c-d9ca0cef2486 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.788277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69482a38-62d1-4d6c-a981-b1d47796cb32 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.793040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.793752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.794032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.794340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.795216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.797206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.800985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.801661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.801947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.802255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.802976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.804880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.826064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 782/1555] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.826836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.835811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 774/1556] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.836747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.905058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fda38b-adea-4035-be68-fd18cba10a8a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.912093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1fcdb-2c4a-46c9-85ce-30df17feb3e5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:37.912600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.913374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.913665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.913938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.914726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.916677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.916949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:37.917616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:37.917950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:37.918235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:37.918934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:37.920967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:37.947255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 783/1557] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.948410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:37.952255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 775/1558] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:37.956346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.011508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef36604-4f8b-4a96-90e6-847988e38251 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.020818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba237-c368-48ad-93a4-25becb7ffb40 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.025696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.026390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.026671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.026941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.027680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.029328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.039785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 776/1559] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:37 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.040712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.054527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd25a-6dcb-46ee-8b21-c23f8a8d4ad4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.059808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.061151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.061151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.061151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.061804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.063832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.068614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.069412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.069692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.069963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.070712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.072833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.090210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 777/1560] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.090210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.099924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fd48a-f870-424b-9f2c-a47296dcad61 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.106873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 784/1561] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:37 2021] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.106873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.107103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.107103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.107103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.107103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.107469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.109176 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.137736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 778/1562] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.138641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.170851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3159b6-3225-4719-9cb9-73ffbf2261d0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.212549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c315cf3-d408-4783-ac98-93517bdf1e34 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.218378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.219132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.219417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.219691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.220409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.222396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.226687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.227367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.227647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.227922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.228627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.230707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.251061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 779/1563] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.251061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.254131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 785/1564] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.255273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.265817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d574e0-d017-47ee-afd8-4945336b3903 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.270918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.271798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.272083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.272354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.273096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.275084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.275735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584d77c-8a35-4242-ba76-79c77d82e7bd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.283684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.285142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.285860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.286418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.287742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.291573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.298627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 780/1565] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.302640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.314316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98c154-9261-4f04-9ffa-7b84c9b49c2c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.318101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 786/1566] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.319097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.320224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.321209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.321510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.321783 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] PATH_INFO: `/v3/projects/1123d21f2250442ba942f58515c7eebe/users/7e246e882eec42d3830903af65312203/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.329733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc7719-698b-46a3-8d29-1ae671e2876f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.335134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.335849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.336203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.336437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.337200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.337493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1123d21f2250442ba942f58515c7eebe, user_id=7e246e882eec42d3830903af65312203, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.338860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.340190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.350671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 787/1567] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.351408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.358142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 781/1568] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/1123d21f2250442ba942f58515c7eebe/users/7e246e882eec42d3830903af65312203/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:38.359587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.362363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff128-6ed9-41d4-a659-87c28e5f8386 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.423372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.424174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.424455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.424727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.425447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.425841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ea12d-cae8-4ee2-9f62-57d5cfe94059 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.427513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.430589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.431269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.431556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.431811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.432537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.434521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.452019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 788/1569] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.452019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.459361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 782/1570] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:38.463153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.463882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9d29c-39e6-4e3c-997f-7659a8c14233 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.469222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.469900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.470228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.470510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.471263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.473155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.473674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39b26-e76e-4d51-a3d3-5c8651d1a7e0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.478770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.479451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.479736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.480014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.480794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.482434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.483600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 789/1571] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.487596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.496290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 783/1572] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.496290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.497968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9d9fd-0e2d-4f54-8a33-ae884ce54ba9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.502836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.504346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1f03-81e5-490d-9691-9a7b31cdd7a5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.509288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.509835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2949c-3268-44bc-850c-211834c41a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.510493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.510627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2949c-3268-44bc-850c-211834c41a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.510724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.510802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2949c-3268-44bc-850c-211834c41a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.511190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2949c-3268-44bc-850c-211834c41a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.511510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.511789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2949c-3268-44bc-850c-211834c41a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.513044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.513386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2949c-3268-44bc-850c-211834c41a4c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.524157 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 790/1573] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.527263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 784/1574] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.527403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.527504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.527504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.527504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.535344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab0bf9-5f74-451c-b356-ed5e46248d4a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.540498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.541167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.541441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.541746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.542506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.544122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.553964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] MFA Rules not processed for user `7e246e882eec42d3830903af65312203`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:38.554124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 791/1575] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.557416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.557502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:38.564535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ffede-e3f9-45a1-a4cf-c5287a9102bd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.569081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.569728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.570005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.570316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.571084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.572870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.586141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 792/1576] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.586906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.597987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d6200-3c0d-4726-8dab-32a38fcd41c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.603304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.603899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.604176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.604446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.605182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.606865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.619108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 793/1577] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.620379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.629912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 785/1578] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:38 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:38.631006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.631708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc0b7-932e-48e9-90c4-7537ea9c2e54 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.638884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.639584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.639979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.640283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.640953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.642761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d921-fd7a-4614-83d5-aed80b25da0e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.642894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.648299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.649004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.649332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.649534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.650424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.652193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.653852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 794/1579] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.655013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.663841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 786/1580] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.664736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.666621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961f504-dc0d-48b8-9fe9-654d18d99f1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.671829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.672587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.672867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.673144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.673891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.675533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.675652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311fc5a-f500-4649-89e2-29c3ccaad197 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.680242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.680904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.681187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.681517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.682323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.683926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.685826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 795/1581] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.686729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.698743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 787/1582] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.698743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.699065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b2f9-4bdf-4247-ad5a-3c101b718969 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.701518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.702737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.703078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.703360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] PATH_INFO: `/v3/projects/f5c60a77a9e14defb1cbca4e34871865/users/ed271ee2a33f484ebb184fd30f99281b/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.707178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607d01-e457-4f5c-a500-7fa62f06cbd0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.712001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.712684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.713115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.713412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.714174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.715816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.719138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c60a77a9e14defb1cbca4e34871865, user_id=ed271ee2a33f484ebb184fd30f99281b, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.721808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.727491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 788/1583] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.728516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.738861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d4346-12c6-4ff0-a220-3e56da149c3c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.739270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 796/1584] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/f5c60a77a9e14defb1cbca4e34871865/users/ed271ee2a33f484ebb184fd30f99281b/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:38.740074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.800578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b4203-8c30-45f2-a5ed-d3851f1be14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.800926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962b094-6bef-4d8c-9c15-e03bdea640f9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.801257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b4203-8c30-45f2-a5ed-d3851f1be14d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.801534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b4203-8c30-45f2-a5ed-d3851f1be14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.801816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b4203-8c30-45f2-a5ed-d3851f1be14d admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.802606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b4203-8c30-45f2-a5ed-d3851f1be14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.804275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b4203-8c30-45f2-a5ed-d3851f1be14d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.805664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.806590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.806875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.807150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] PATH_INFO: `/v3/projects/67316d1933764478b6e2d223b58f9e3a/users/ac902890430b4722b22d320e85187a8e/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.814200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 789/1585] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:38 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:38.815533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7ffa-d6f3-4fb8-a78f-33ef7616f9e3 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.815817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7ffa-d6f3-4fb8-a78f-33ef7616f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.816092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7ffa-d6f3-4fb8-a78f-33ef7616f9e3 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.818057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 790/1586] 10.222.0.60 () {54 vars in 960 bytes} [Wed Nov 10 15:54:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:54:38.818798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7ffa-d6f3-4fb8-a78f-33ef7616f9e3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.821786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67316d1933764478b6e2d223b58f9e3a, user_id=ac902890430b4722b22d320e85187a8e, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.824498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.831397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7ffa-d6f3-4fb8-a78f-33ef7616f9e3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.836438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.837353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.837794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.838028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] PATH_INFO: `/v3/projects/d0b05ad418584ca19686c99ea57da374/users/9f70acf2d84d44c896f1d284b84fa9d4/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.839603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 797/1587] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/67316d1933764478b6e2d223b58f9e3a/users/ac902890430b4722b22d320e85187a8e/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:38.840359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.862874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b05ad418584ca19686c99ea57da374, user_id=9f70acf2d84d44c896f1d284b84fa9d4, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.865457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.880947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 791/1588] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/d0b05ad418584ca19686c99ea57da374/users/9f70acf2d84d44c896f1d284b84fa9d4/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:38.881759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.909301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017d5f-6688-47b9-bc96-c24d732f27b5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.944853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ec590-93a7-4883-ab8d-28ffb9a88f20 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:38.949582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.950511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.950815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.951070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] PATH_INFO: `/v3/projects/0dd24ae3ef4a4a6a9e00af4451e227ee/users/7083fa631bcd46f299ac2d6ff54bb94b/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.966716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd24ae3ef4a4a6a9e00af4451e227ee, user_id=7083fa631bcd46f299ac2d6ff54bb94b, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.966965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0f4f-6933-4bd8-88f5-d816356018ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:38.967627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0f4f-6933-4bd8-88f5-d816356018ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:38.967927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0f4f-6933-4bd8-88f5-d816356018ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:38.968202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0f4f-6933-4bd8-88f5-d816356018ea admin admin] PATH_INFO: `/v3/projects/62bd1b74f2b24e83b2fe9a8e301f43e7/users/d6029b1cd7e04bf8b9aa071a6664af0d/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:38.969462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:38.983658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c0f4f-6933-4bd8-88f5-d816356018ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bd1b74f2b24e83b2fe9a8e301f43e7, user_id=d6029b1cd7e04bf8b9aa071a6664af0d, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:38.984406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 792/1589] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/0dd24ae3ef4a4a6a9e00af4451e227ee/users/7083fa631bcd46f299ac2d6ff54bb94b/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:38.985279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:38.986680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c0f4f-6933-4bd8-88f5-d816356018ea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.001724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 798/1590] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/62bd1b74f2b24e83b2fe9a8e301f43e7/users/d6029b1cd7e04bf8b9aa071a6664af0d/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:39.010551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.010551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.010551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.022131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.023501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.070276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1a02-6ccb-40f7-ac7c-b4f5af53451b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.087650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 799/1591] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.088588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.099441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c680e24-5a00-46e8-a008-143c4118d5a6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.104550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f84424-632a-40c3-9c4a-2041e656855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.105466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f84424-632a-40c3-9c4a-2041e656855b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.105758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f84424-632a-40c3-9c4a-2041e656855b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.106026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f84424-632a-40c3-9c4a-2041e656855b admin admin] PATH_INFO: `/v3/projects/afdef68d92a74674954201b0a98c3388/users/6b5c8b754a994115a2b61a3b1024497e/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.122265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f84424-632a-40c3-9c4a-2041e656855b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdef68d92a74674954201b0a98c3388, user_id=6b5c8b754a994115a2b61a3b1024497e, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.125159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f84424-632a-40c3-9c4a-2041e656855b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.133122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4459de-bac4-4a0b-a836-17e5c2d4300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.134029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4459de-bac4-4a0b-a836-17e5c2d4300f admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.134339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4459de-bac4-4a0b-a836-17e5c2d4300f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.134626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4459de-bac4-4a0b-a836-17e5c2d4300f admin admin] PATH_INFO: `/v3/projects/957858dcc5384487a7ef337124998c1b/users/214880bcabcd45dd89753e769ca07220/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.140543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 800/1592] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:39 2021] PUT /identity/v3/projects/afdef68d92a74674954201b0a98c3388/users/6b5c8b754a994115a2b61a3b1024497e/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:39.141970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621d3a-a07c-4931-9cf3-d19f0775e8da None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.142446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621d3a-a07c-4931-9cf3-d19f0775e8da None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.142749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621d3a-a07c-4931-9cf3-d19f0775e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.155998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4459de-bac4-4a0b-a836-17e5c2d4300f admin admin] RBAC: Authorizing `identity:create_grant(project_id=957858dcc5384487a7ef337124998c1b, user_id=214880bcabcd45dd89753e769ca07220, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.160479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4459de-bac4-4a0b-a836-17e5c2d4300f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.168551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e8621d3a-a07c-4931-9cf3-d19f0775e8da None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.169776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e8621d3a-a07c-4931-9cf3-d19f0775e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.175595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 793/1593] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:38 2021] PUT /identity/v3/projects/957858dcc5384487a7ef337124998c1b/users/214880bcabcd45dd89753e769ca07220/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:39.176976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95cf5-38b2-43a9-bfb1-4ceba79a6181 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.177271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95cf5-38b2-43a9-bfb1-4ceba79a6181 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.177551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95cf5-38b2-43a9-bfb1-4ceba79a6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.204449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-daa95cf5-38b2-43a9-bfb1-4ceba79a6181 None None] MFA Rules not processed for user `ac902890430b4722b22d320e85187a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.205680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-daa95cf5-38b2-43a9-bfb1-4ceba79a6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.235888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 801/1594] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.237391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587933d4-2fe3-4baa-984f-c978b310aa21 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.237712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587933d4-2fe3-4baa-984f-c978b310aa21 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.237959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587933d4-2fe3-4baa-984f-c978b310aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.257513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-587933d4-2fe3-4baa-984f-c978b310aa21 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.259178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-587933d4-2fe3-4baa-984f-c978b310aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.277860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 794/1595] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.279015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.279302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.279577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.306632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] MFA Rules not processed for user `7083fa631bcd46f299ac2d6ff54bb94b`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.307870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.324487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 802/1596] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.325841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88616-208b-48db-bc55-284f341cbec9 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.326129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88616-208b-48db-bc55-284f341cbec9 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.326437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88616-208b-48db-bc55-284f341cbec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.352743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4ca88616-208b-48db-bc55-284f341cbec9 None None] MFA Rules not processed for user `d6029b1cd7e04bf8b9aa071a6664af0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.353975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4ca88616-208b-48db-bc55-284f341cbec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.372590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 795/1597] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.373391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.420310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 803/1598] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.422001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.422341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.422625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.428664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b887467-18e8-4d95-b8f5-90fd46d378ce None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.432454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caddb59-fafd-45ab-8d11-95bcb3455c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.433188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caddb59-fafd-45ab-8d11-95bcb3455c4f service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.433464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caddb59-fafd-45ab-8d11-95bcb3455c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.433734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caddb59-fafd-45ab-8d11-95bcb3455c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.443804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caddb59-fafd-45ab-8d11-95bcb3455c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.445296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caddb59-fafd-45ab-8d11-95bcb3455c4f service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.448812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] MFA Rules not processed for user `6b5c8b754a994115a2b61a3b1024497e`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.450052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.455367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 796/1599] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:39.456632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.456924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.457196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.475458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.476687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.489082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 797/1600] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.489082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.507668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfe7a5-984a-4044-bc5a-4e89e05be12c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.514366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.515134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.515396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.515686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.525263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 804/1601] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.528914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.587521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.587773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edd02-b152-48a6-b9e7-3bdbec7b1ed0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.588609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.591781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e76a7a-a8b9-4a0d-b430-e262acb7c5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.592471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76a7a-a8b9-4a0d-b430-e262acb7c5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.592782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76a7a-a8b9-4a0d-b430-e262acb7c5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.593060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76a7a-a8b9-4a0d-b430-e262acb7c5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.600183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 798/1602] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:39 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:39.601248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.611686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7edb-f467-46bc-8808-5b2452270292 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.615899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.616570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.616858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.617134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.617783 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e76a7a-a8b9-4a0d-b430-e262acb7c5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.621819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e76a7a-a8b9-4a0d-b430-e262acb7c5c3 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.627512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.628918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.635292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 805/1603] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:39 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:39.640878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 799/1604] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:39.648029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.652084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48153-1401-4a54-8d33-32b12adedb6d None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.652084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48153-1401-4a54-8d33-32b12adedb6d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.652084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca48153-1401-4a54-8d33-32b12adedb6d None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.656885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 806/1605] 10.222.0.60 () {54 vars in 960 bytes} [Wed Nov 10 15:54:39 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:54:39.657687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca48153-1401-4a54-8d33-32b12adedb6d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.667098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d1e5f-6b51-4107-8f3e-8ff9c17715ba service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.676258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2041901-a88b-4f78-977b-dde96719d3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.676963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2041901-a88b-4f78-977b-dde96719d3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.677246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2041901-a88b-4f78-977b-dde96719d3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.677525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2041901-a88b-4f78-977b-dde96719d3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.685697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca48153-1401-4a54-8d33-32b12adedb6d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.695903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2041901-a88b-4f78-977b-dde96719d3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.697347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2041901-a88b-4f78-977b-dde96719d3a2 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.705293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.705293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.705293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.705293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.705601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.707510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.722437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 800/1606] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:39.725390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197cf2-705b-46db-adb3-4a760ccb22e3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.725681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197cf2-705b-46db-adb3-4a760ccb22e3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.725960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197cf2-705b-46db-adb3-4a760ccb22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.767383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 807/1607] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:39.769493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.774782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-e3197cf2-705b-46db-adb3-4a760ccb22e3 None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:39.779036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e3197cf2-705b-46db-adb3-4a760ccb22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:39.917163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a4f96-7619-43d8-bd6e-8f5a750e14df admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:39.929858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284eb5-8474-41b3-ad7e-2fbea6e91c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:39.931164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284eb5-8474-41b3-ad7e-2fbea6e91c3a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.932889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284eb5-8474-41b3-ad7e-2fbea6e91c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.933183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284eb5-8474-41b3-ad7e-2fbea6e91c3a admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.934138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284eb5-8474-41b3-ad7e-2fbea6e91c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:39.938558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284eb5-8474-41b3-ad7e-2fbea6e91c3a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:39.943419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 801/1608] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:39.947313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a54d84-ba51-4508-a586-9b21a99a696b None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.947586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a54d84-ba51-4508-a586-9b21a99a696b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.947861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a54d84-ba51-4508-a586-9b21a99a696b None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:39.952120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 802/1609] 10.222.0.60 () {54 vars in 912 bytes} [Wed Nov 10 15:54:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:54:39.954667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a54d84-ba51-4508-a586-9b21a99a696b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:39.992956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 808/1610] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:39.994671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:39.994955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:39.995227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.001158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a54d84-ba51-4508-a586-9b21a99a696b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:40.019829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:40.020525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.021459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.021459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.053677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:40.056913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:40.086375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 809/1611] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:54:39 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:40.087386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:40.120909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde200-f366-47e6-8390-d5e3416a6ab8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:40.138988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:40.139808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.140113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.140380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.141150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:40.142914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:40.149122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:40.151674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:40.167564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 803/1612] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:39 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:40.169127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 810/1613] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:40.173463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:40.173726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:40.227637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a485d8-7f85-43ad-b3d8-8043edbfcaca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:40.252505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e335c8-48a6-4afe-a200-7a4a858e2925 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:40.258212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:40.259123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.259510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.259901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.260959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:40.262133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.262624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.263065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] PATH_INFO: `/v3/projects/71debec8048d4e5792de3289e3f1bd00/users/b00dceebbfdb41c7b0ce406acda41de2/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.276311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:40.278254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:40.301108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=71debec8048d4e5792de3289e3f1bd00, user_id=b00dceebbfdb41c7b0ce406acda41de2, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:40.304692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:40.317512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 804/1614] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:40.333624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 811/1615] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:40 2021] PUT /identity/v3/projects/71debec8048d4e5792de3289e3f1bd00/users/b00dceebbfdb41c7b0ce406acda41de2/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:40.340671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:40.370046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0527f-9620-45c4-a905-b965929c80ab service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:40.504744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9a69d-7da8-4924-8785-b010136ed88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:40.505729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a69d-7da8-4924-8785-b010136ed88b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.506013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a69d-7da8-4924-8785-b010136ed88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.507215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a69d-7da8-4924-8785-b010136ed88b admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.508072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9a69d-7da8-4924-8785-b010136ed88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:40.510124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9a69d-7da8-4924-8785-b010136ed88b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:40.539633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 805/1616] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:40.540597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:40.556263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2439-d03f-4349-83a1-18c5c3e072ed admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:40.570789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a03132-0374-4a11-9ed5-431b3bdc17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:40.571710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a03132-0374-4a11-9ed5-431b3bdc17a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.571993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a03132-0374-4a11-9ed5-431b3bdc17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.572271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a03132-0374-4a11-9ed5-431b3bdc17a3 admin admin] PATH_INFO: `/v3/projects/71debec8048d4e5792de3289e3f1bd00/users/b00dceebbfdb41c7b0ce406acda41de2/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.579291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a03132-0374-4a11-9ed5-431b3bdc17a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71debec8048d4e5792de3289e3f1bd00, user_id=b00dceebbfdb41c7b0ce406acda41de2, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:40.582184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a03132-0374-4a11-9ed5-431b3bdc17a3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:40.605761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 812/1617] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:40 2021] PUT /identity/v3/projects/71debec8048d4e5792de3289e3f1bd00/users/b00dceebbfdb41c7b0ce406acda41de2/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:40.620984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.621307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.621583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.683198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639fa0-7996-413b-b591-b4f7178adb76 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.683489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639fa0-7996-413b-b591-b4f7178adb76 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.683769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639fa0-7996-413b-b591-b4f7178adb76 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.685554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 813/1618] 10.222.0.60 () {54 vars in 912 bytes} [Wed Nov 10 15:54:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:54:40.688411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] MFA Rules not processed for user `b00dceebbfdb41c7b0ce406acda41de2`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:40.690043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:40.691639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:40.691925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:40.692462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:40.726181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:40.727389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:40.847456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 806/1619] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:40 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:40.859029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:40.893514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 814/1620] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:54:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:40.994312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686a8c7-c789-4071-9887-168ad84226d4 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:41.007160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:41.009360 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:41.011010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:41.011475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:41.043428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:41.045871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:41.085573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 807/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:40 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:41.129443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:41.139441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b19c69-672a-4268-b32d-7a23c1cd5e19 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:41.151052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cdd08-55f9-468f-b5a8-f7c40f3d2001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:41.151980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cdd08-55f9-468f-b5a8-f7c40f3d2001 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:41.152464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cdd08-55f9-468f-b5a8-f7c40f3d2001 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:41.152929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cdd08-55f9-468f-b5a8-f7c40f3d2001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:41.180391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cdd08-55f9-468f-b5a8-f7c40f3d2001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:41.183210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cdd08-55f9-468f-b5a8-f7c40f3d2001 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:41.213917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 815/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:41.383365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:41.411230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58250-22d6-4ac1-822e-09ec78170a7c service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:41.462592 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6224e5-faba-49b4-baa1-6d6b4693dd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:41.466995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6224e5-faba-49b4-baa1-6d6b4693dd65 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:41.469775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6224e5-faba-49b4-baa1-6d6b4693dd65 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:41.469968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6224e5-faba-49b4-baa1-6d6b4693dd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:41.614087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6224e5-faba-49b4-baa1-6d6b4693dd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:41.617314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6224e5-faba-49b4-baa1-6d6b4693dd65 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:41.642476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 808/1623] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:41 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:41.880372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:41.880944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:41.881424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:41.960368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] MFA Rules not processed for user `214880bcabcd45dd89753e769ca07220`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:41.963356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:42.143582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 816/1624] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:42.158624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:42.161335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:42.162266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:42.211068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] MFA Rules not processed for user `214880bcabcd45dd89753e769ca07220`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:42.212393 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:42.234147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 809/1625] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:42 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:42.258821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:42.281309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:42.292561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2470e31-9416-4be4-bc87-b80199e8b7c1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:42.322357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eed6ee-dc9d-4b74-a293-58810a1857b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:42.323762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eed6ee-dc9d-4b74-a293-58810a1857b3 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:42.324056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eed6ee-dc9d-4b74-a293-58810a1857b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:42.324346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eed6ee-dc9d-4b74-a293-58810a1857b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:42.356255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eed6ee-dc9d-4b74-a293-58810a1857b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:42.357904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eed6ee-dc9d-4b74-a293-58810a1857b3 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:42.364419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61d371-b69c-4e03-ac7a-a27e0ca9fc6b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:42.370334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:42.371711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:42.372128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:42.372574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] PATH_INFO: `/v3/users/d6029b1cd7e04bf8b9aa071a6664af0d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:42.374389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6029b1cd7e04bf8b9aa071a6664af0d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:42.375755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: WARNING py.warnings [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:54:42.375755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: warnings.warn(msg) Nov 10 15:54:42.375755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: Nov 10 15:54:42.377333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:42.407522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 817/1626] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:42 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:42.517140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6029b1cd7e04bf8b9aa071a6664af0d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:42.523304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6029b1cd7e04bf8b9aa071a6664af0d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:42.525717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6029b1cd7e04bf8b9aa071a6664af0d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:42.539793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6029b1cd7e04bf8b9aa071a6664af0d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:42.585519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6029b1cd7e04bf8b9aa071a6664af0d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:42.611416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 810/1627] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:42 2021] DELETE /identity/v3/users/d6029b1cd7e04bf8b9aa071a6664af0d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:54:42.620387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef5a0-bd60-4866-9ca3-0dc7a5642e97 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:42.620747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef5a0-bd60-4866-9ca3-0dc7a5642e97 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:42.621099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef5a0-bd60-4866-9ca3-0dc7a5642e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:42.677326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-abfef5a0-bd60-4866-9ca3-0dc7a5642e97 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:42.683205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-abfef5a0-bd60-4866-9ca3-0dc7a5642e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:42.837277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 818/1628] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:42.993225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:42.995196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:43.103689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8f1e-2118-4d10-92a9-5cf9234eb397 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:43.109246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc8b92-cbe3-43a9-bc4c-e27db650a893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:43.113329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8b92-cbe3-43a9-bc4c-e27db650a893 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:43.113615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8b92-cbe3-43a9-bc4c-e27db650a893 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:43.113895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc8b92-cbe3-43a9-bc4c-e27db650a893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:43.126284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc8b92-cbe3-43a9-bc4c-e27db650a893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:43.129077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc8b92-cbe3-43a9-bc4c-e27db650a893 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:43.145573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 811/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:43.668675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01fe45-4800-4f6d-9ef4-df0dd28db61e None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:43.669289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01fe45-4800-4f6d-9ef4-df0dd28db61e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:43.669289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01fe45-4800-4f6d-9ef4-df0dd28db61e None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:43.671448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 819/1630] 10.222.0.60 () {54 vars in 912 bytes} [Wed Nov 10 15:54:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:54:43.685599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:43.686052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:43.686196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:43.721551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] MFA Rules not processed for user `2ecc2dca57d045869f1fcf3a4337b990`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:43.727856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:43.776233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 812/1631] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:54:43 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:43.835565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01fe45-4800-4f6d-9ef4-df0dd28db61e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:43.872214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01fe45-4800-4f6d-9ef4-df0dd28db61e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:43.886095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9395-0da2-4662-9e16-7f775ce61a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:43.895268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9395-0da2-4662-9e16-7f775ce61a6d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:43.902655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9395-0da2-4662-9e16-7f775ce61a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:43.903201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9395-0da2-4662-9e16-7f775ce61a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:43.923602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9395-0da2-4662-9e16-7f775ce61a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:43.925282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9395-0da2-4662-9e16-7f775ce61a6d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:43.955472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 820/1632] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:44.270233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:44.271979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:44.298271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff21b9-b223-4d1d-801c-4ff6ef8250a3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:44.305961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:44.307282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:44.307650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:44.308023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] PATH_INFO: `/v3/users/6b5c8b754a994115a2b61a3b1024497e` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:44.310674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5c8b754a994115a2b61a3b1024497e)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:44.314986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:44.445928 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5c8b754a994115a2b61a3b1024497e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.446716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5c8b754a994115a2b61a3b1024497e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.447348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5c8b754a994115a2b61a3b1024497e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.463818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5c8b754a994115a2b61a3b1024497e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.495039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5c8b754a994115a2b61a3b1024497e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.524064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 813/1633] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:44 2021] DELETE /identity/v3/users/6b5c8b754a994115a2b61a3b1024497e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:44.530821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:44.531290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:44.531773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:44.560171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:44.562318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:44.651208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:44.654184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:44.663795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 821/1634] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:44.681178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d99d-b326-4611-8512-c47f8cc90bbd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:44.684388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:44.688490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:44.693619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:44.695384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:44.695716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:44.696364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] PATH_INFO: `/v3/projects/62bd1b74f2b24e83b2fe9a8e301f43e7` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:44.711434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bd1b74f2b24e83b2fe9a8e301f43e7)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:44.716864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:44.873223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cb9ec-3ba4-4436-8ca0-0db5c95915ae None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:44.909415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bd1b74f2b24e83b2fe9a8e301f43e7', 'request_id': 'req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.922469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bd1b74f2b24e83b2fe9a8e301f43e7', 'request_id': 'req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.936671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bd1b74f2b24e83b2fe9a8e301f43e7', 'request_id': 'req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.960510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] The token cache is being invalidate because project 62bd1b74f2b24e83b2fe9a8e301f43e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:44.961114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.962867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c0cddbf-dfba-406b-b753-e09ccc1c6d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:44.966188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 814/1635] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:44 2021] DELETE /identity/v3/projects/62bd1b74f2b24e83b2fe9a8e301f43e7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:44.975238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16097eeb-a601-4cc8-af01-42a08386c2cb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:44.975547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16097eeb-a601-4cc8-af01-42a08386c2cb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:44.975827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16097eeb-a601-4cc8-af01-42a08386c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.010710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.011522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.013178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.013334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-16097eeb-a601-4cc8-af01-42a08386c2cb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:45.013641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.014737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-16097eeb-a601-4cc8-af01-42a08386c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:45.019953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:45.206480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.208332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.215015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 815/1636] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:45.216893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.217337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.218021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.280918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 822/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:54:45.296574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:45.297887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:45.332374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 816/1638] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:45.337181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.356442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4fbdf-c8f4-4230-98ed-90f009d8b100 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.380148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.381091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.381320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.381688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.382361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:45.382666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.385127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386734-2c54-476e-b872-966913a27876 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.416631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 823/1639] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:45.422039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.431425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d2d56-2082-4c03-bac3-2db2755541c0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.436804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.444909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.445202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.445486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.446269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.446949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae391f7-c79a-4ea3-804b-3bff38b5b92c None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.447395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae391f7-c79a-4ea3-804b-3bff38b5b92c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.447834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae391f7-c79a-4ea3-804b-3bff38b5b92c None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.448245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.449986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 824/1640] 10.222.0.60 () {54 vars in 960 bytes} [Wed Nov 10 15:54:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:54:45.457184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.458733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.459189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.504964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 817/1641] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:45 2021] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:45.506507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.507064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:45.508481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:45.654329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56385-8359-494a-97a7-9e5719d51514 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.660524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.661247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.661529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.661970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.662774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.664882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.694442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 818/1642] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:45 2021] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:45.701423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.717365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a367bf-dbb7-458c-86d4-411432ebbd6b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.723298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 825/1643] 10.222.0.60 () {58 vars in 1057 bytes} [Wed Nov 10 15:54:45 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:45.724788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.725791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.726373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.726994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.728855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.731099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.737061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.748632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 819/1644] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:45 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:45.755096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.770618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544eab-74e2-4ea5-b954-8f8ffee900d1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.771946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f5874-927d-412d-b077-f0a21f0da9bc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.779306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.780618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.781101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.781560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.783657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.787040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.787301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.788401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.788890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.790568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.795372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:45.803343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 820/1645] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:45 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:45.811560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:45.825327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51de54-64dd-472a-a945-c20b76277c42 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:45.840718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2055-35f7-479f-8138-841471682445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:45.842684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.843874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2055-35f7-479f-8138-841471682445 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.844168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2055-35f7-479f-8138-841471682445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.844451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2055-35f7-479f-8138-841471682445 admin admin] PATH_INFO: `/v3/projects/593e338ca89740889af4acdd9bc4e4d5/users/bd13b1f55af541c681c850dac7822f86/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:45.848869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab76152-0b87-4a5c-bfef-a3655f668f5a service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.887255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 826/1646] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:45 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:54:45.895932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2055-35f7-479f-8138-841471682445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593e338ca89740889af4acdd9bc4e4d5, user_id=bd13b1f55af541c681c850dac7822f86, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:45.899333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2055-35f7-479f-8138-841471682445 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:45.936610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 821/1647] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:45 2021] PUT /identity/v3/projects/593e338ca89740889af4acdd9bc4e4d5/users/bd13b1f55af541c681c850dac7822f86/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:45.948129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:45.949760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:45.950325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:46.013882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] MFA Rules not processed for user `bd13b1f55af541c681c850dac7822f86`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:46.021008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:46.162071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2055-35f7-479f-8138-841471682445 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:46.163483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 827/1648] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:45 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:46.343467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2055-35f7-479f-8138-841471682445 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:46.363431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:46.365586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:46.365876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:46.366153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:46.368112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:46.373422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:46.432945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 822/1649] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:46 2021] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:46.437504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:46.451239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ba027-bb79-4e7b-b559-fcbf86b24343 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:46.524945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:46.527051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:46.640152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:46.640903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:46.641185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:46.641462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:46.642261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:46.646411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:46.694932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 828/1650] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:46 2021] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:46.696254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:46.707808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f833d4-426b-42ea-88e5-e72a7f22bdab admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:46.721244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99dee9-a05d-456a-8048-c55cfcbda396 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:46.721943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:46.737381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:46.738117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:46.738586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:46.739010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:46.740218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:46.740636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:46.741082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:46.742562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:46.744396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] PATH_INFO: `/v3/projects/afdef68d92a74674954201b0a98c3388` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:46.749302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdef68d92a74674954201b0a98c3388)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:46.757278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:46.758401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 829/1651] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:46.759533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:46.770516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b17e7-aff7-4f57-a9fc-bf1fca94ad58 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:46.778336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:46.779695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:46.780337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:46.780784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] PATH_INFO: `/v3/projects/cdf330b17d224c68b9b5ddb8a16eb272/users/84ab617493724926a54880d16a3a924b/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:46.800766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf330b17d224c68b9b5ddb8a16eb272, user_id=84ab617493724926a54880d16a3a924b, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:46.804462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:46.835862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 830/1652] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:46 2021] PUT /identity/v3/projects/cdf330b17d224c68b9b5ddb8a16eb272/users/84ab617493724926a54880d16a3a924b/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:46.838940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:46.933134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdef68d92a74674954201b0a98c3388', 'request_id': 'req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:46.952989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdef68d92a74674954201b0a98c3388', 'request_id': 'req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:46.964402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdef68d92a74674954201b0a98c3388', 'request_id': 'req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:46.988845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] The token cache is being invalidate because project afdef68d92a74674954201b0a98c3388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:46.989324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:46.990439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:46.993482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 823/1653] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:46 2021] DELETE /identity/v3/projects/afdef68d92a74674954201b0a98c3388 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:54:47.001122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:47.005449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:47.068090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e21658-82bb-4c5a-86f7-d3f826f37e33 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:47.203626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:47.206705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:47.210123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:47.211190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:47.212924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:47.226181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:47.250802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d702f-96af-4cb5-9e60-62a0c8b94b2c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:47.265049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:47.266260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:47.266550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:47.266831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] PATH_INFO: `/v3/users/b00dceebbfdb41c7b0ce406acda41de2` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:47.267991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 831/1654] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:47.271647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00dceebbfdb41c7b0ce406acda41de2)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:47.275123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:47.277769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:47.279186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:47.310942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb0752-86d4-4d66-ba5b-74f421023b71 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:47.327155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5626ba-be65-41d8-9db7-46dd072fa4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:47.328590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5626ba-be65-41d8-9db7-46dd072fa4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:47.328885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5626ba-be65-41d8-9db7-46dd072fa4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:47.329162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5626ba-be65-41d8-9db7-46dd072fa4cb admin admin] PATH_INFO: `/v3/projects/cdf330b17d224c68b9b5ddb8a16eb272/users/84ab617493724926a54880d16a3a924b/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:47.336596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5626ba-be65-41d8-9db7-46dd072fa4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf330b17d224c68b9b5ddb8a16eb272, user_id=84ab617493724926a54880d16a3a924b, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:47.343481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5626ba-be65-41d8-9db7-46dd072fa4cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:47.373230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 832/1655] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:47 2021] PUT /identity/v3/projects/cdf330b17d224c68b9b5ddb8a16eb272/users/84ab617493724926a54880d16a3a924b/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:47.376336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:47.377877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:47.378470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:47.428102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] MFA Rules not processed for user `84ab617493724926a54880d16a3a924b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:47.429522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:47.462754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00dceebbfdb41c7b0ce406acda41de2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.463972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00dceebbfdb41c7b0ce406acda41de2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.466114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00dceebbfdb41c7b0ce406acda41de2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.481862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00dceebbfdb41c7b0ce406acda41de2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.510886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00dceebbfdb41c7b0ce406acda41de2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.544872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 824/1656] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:46 2021] DELETE /identity/v3/users/b00dceebbfdb41c7b0ce406acda41de2 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:47.677503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:47.678448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 833/1657] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:47 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:47.690404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:47.801138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271460-a9e4-4533-9811-8fa2a26b9397 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:47.814847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:47.815973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:47.816356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:47.817003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] PATH_INFO: `/v3/users/7083fa631bcd46f299ac2d6ff54bb94b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:47.819509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7083fa631bcd46f299ac2d6ff54bb94b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:47.824855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:47.854671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:47.857720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:47.971201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7083fa631bcd46f299ac2d6ff54bb94b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.975332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7083fa631bcd46f299ac2d6ff54bb94b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:47.976559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7083fa631bcd46f299ac2d6ff54bb94b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:48.008133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7083fa631bcd46f299ac2d6ff54bb94b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:48.039777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5e7b2b4d-2fac-4f69-848d-496b4af7abb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7083fa631bcd46f299ac2d6ff54bb94b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:48.115446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 825/1658] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:47 2021] DELETE /identity/v3/users/7083fa631bcd46f299ac2d6ff54bb94b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:48.123464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:48.124048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:48.124483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:48.137230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afd112-58c9-4386-a9bb-ef697e167024 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:48.217811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:48.228324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:48.333838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:48.334885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:48.335336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:48.336009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:48.339998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:48.420667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 826/1659] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:48.522752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:48.524712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:48.553127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 834/1660] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:47 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:54:48.677215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:48.679190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:48.875091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623882c-83ef-4141-92c3-dc2a321be55e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:48.886942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:48.887882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:48.888267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:48.888480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:48.915290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:48.921626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:48.950848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 827/1661] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:49.417377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:49.419468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:49.459028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aead245-14db-4ff8-8a00-7e24aa8fa439 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:49.466784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:49.468142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:49.468810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:49.469414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] PATH_INFO: `/v3/users/7e246e882eec42d3830903af65312203` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:49.472492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e246e882eec42d3830903af65312203)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:49.486821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:49.522123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:49.524247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:49.581899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be4ad7-c85d-4c8e-87d9-f69a08e80f0c service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:49.612904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:49.617449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:49.621700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:49.626399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] PATH_INFO: `/v3/projects/71debec8048d4e5792de3289e3f1bd00` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:49.632466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71debec8048d4e5792de3289e3f1bd00)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:49.641167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:49.682607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e246e882eec42d3830903af65312203'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.684938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e246e882eec42d3830903af65312203'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.689421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e246e882eec42d3830903af65312203'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.713667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e246e882eec42d3830903af65312203'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.762489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e246e882eec42d3830903af65312203'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.800461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 835/1662] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:49 2021] DELETE /identity/v3/users/7e246e882eec42d3830903af65312203 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:49.801350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:49.807258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:49.809338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71debec8048d4e5792de3289e3f1bd00', 'request_id': 'req-d6a0188b-ad11-413d-a51a-db275ff37234'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.836354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71debec8048d4e5792de3289e3f1bd00', 'request_id': 'req-d6a0188b-ad11-413d-a51a-db275ff37234'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.865974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71debec8048d4e5792de3289e3f1bd00', 'request_id': 'req-d6a0188b-ad11-413d-a51a-db275ff37234'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.932565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] The token cache is being invalidate because project 71debec8048d4e5792de3289e3f1bd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:49.933244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.936876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6a0188b-ad11-413d-a51a-db275ff37234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:49.942510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 828/1663] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:49 2021] DELETE /identity/v3/projects/71debec8048d4e5792de3289e3f1bd00 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:54:49.945730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88b18a-b207-438f-8775-68b2bb916d98 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:49.948589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88b18a-b207-438f-8775-68b2bb916d98 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:49.949500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88b18a-b207-438f-8775-68b2bb916d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.029010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2a88b18a-b207-438f-8775-68b2bb916d98 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:50.030955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2a88b18a-b207-438f-8775-68b2bb916d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.115146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a62d-d74b-4ad5-a3bf-7024ed1c5af8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:50.122247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:50.124605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.125543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.126065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] PATH_INFO: `/v3/users/bd13b1f55af541c681c850dac7822f86` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.128716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd13b1f55af541c681c850dac7822f86)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:50.131208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:50.235722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 829/1664] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:50.243918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbe4e-4c07-4c95-96ae-a48966144963 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.244206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbe4e-4c07-4c95-96ae-a48966144963 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.244681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbe4e-4c07-4c95-96ae-a48966144963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.303292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bfadbe4e-4c07-4c95-96ae-a48966144963 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:50.304597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bfadbe4e-4c07-4c95-96ae-a48966144963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.327490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd13b1f55af541c681c850dac7822f86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:50.331509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd13b1f55af541c681c850dac7822f86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:50.331755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 830/1665] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:50.334618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd13b1f55af541c681c850dac7822f86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:50.336789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.337337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.337776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.351976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd13b1f55af541c681c850dac7822f86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:50.385061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:50.392990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.400485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd13b1f55af541c681c850dac7822f86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:50.452274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 831/1666] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:50.462983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:50.474928 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.494516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 836/1667] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:49 2021] DELETE /identity/v3/users/bd13b1f55af541c681c850dac7822f86 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:50.498110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:50.694817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a2f79-23fc-4314-bba2-5d7e581e61ad None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:50.739113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4927ced-b1ce-4e7e-9a4d-8da04d05bb6f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:50.757936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:50.761143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.762272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.767486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.769656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:50.770729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:50.774814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:50.775832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.776301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.776741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.779025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.781221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe7cb8-3c23-43ef-93b9-859527626f58 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:50.798468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:50.800646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f8efb-afeb-4c49-bcd6-12d28f2e81b9 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:50.825130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 832/1668] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:50.827003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.827748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.828436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.832185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 837/1669] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:50.839323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.845103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.845981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.872916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:50.872916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.884781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 833/1670] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:50.886943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:50.919206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:50.920657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:50.974358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7de859-0379-4e58-b36d-7ea820bff014 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:50.974358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:50.974358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:50.974358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:50.978520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:50.978520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:50.978520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.052739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 834/1671] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:50 2021] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:51.062038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:51.073073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 838/1672] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:54:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:51.074370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:51.075804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:51.102396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d637d-240f-456f-a687-11d0bfac7769 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:51.229768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:51.230478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.230767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.231069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.298776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212644ec-07fa-435c-a101-98dde2b5f207 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:51.315893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:51.316642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.316923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.317195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.323317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:51.325419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.392686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:51.394762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 835/1673] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:51 2021] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:51.396044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:51.397965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.408463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:51.421987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 839/1674] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:51.423338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:51.435326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06c2c-b70b-4b6a-a4a4-86cf6d80bf34 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:51.443098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:51.444540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.445061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.445600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.446709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:51.451628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.475549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 840/1675] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:51 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:51.476987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:51.507833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35c86-5dad-4f2a-a0c1-a900df53ac9d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:51.522120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:51.523214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.523839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.525806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.526786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:51.529615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.561959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 841/1676] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:51 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:51.563417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:51.598429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc104796-b391-49f1-9d14-000d77dd1230 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:51.615058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9d1c-964f-41c8-9cf9-19eb56f0cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:51.616206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9d1c-964f-41c8-9cf9-19eb56f0cb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.616809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9d1c-964f-41c8-9cf9-19eb56f0cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.617488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9d1c-964f-41c8-9cf9-19eb56f0cb10 admin admin] PATH_INFO: `/v3/projects/e092e667dc27433c9f34a26988999478/users/e96b259944a44c7bb8c66df16448377f/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.639724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9d1c-964f-41c8-9cf9-19eb56f0cb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e092e667dc27433c9f34a26988999478, user_id=e96b259944a44c7bb8c66df16448377f, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:51.645475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee37c78-769b-49c5-a304-e9469628956c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:51.645775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9d1c-964f-41c8-9cf9-19eb56f0cb10 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.665378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:51.666684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.666684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.666684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.671468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 842/1677] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:51 2021] PUT /identity/v3/projects/e092e667dc27433c9f34a26988999478/users/e96b259944a44c7bb8c66df16448377f/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:51.738758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:51.739573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:51.740047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:51.792898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:51.794788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:51.800334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] MFA Rules not processed for user `e96b259944a44c7bb8c66df16448377f`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:51.803247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:51.807086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 836/1678] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:54:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:54:52.067796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 843/1679] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:51 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:52.078828 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:52.099764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f83da-81f8-41a0-94d2-ace5da16d105 service swift] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:52.402052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:52.404833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:52.407761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:52.408237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:52.408967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:52.417185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:52.529501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 837/1680] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:52 2021] POST /identity/v3/projects => generated 383 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:52.536419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:52.582794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2ccc0-a383-4fb4-b719-4d6f3d3bd96a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:52.760813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:52.770759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:52.785099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:52.785603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:52.786009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:52.786332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:52.787091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:52.792255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:52.855662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f2111-14fa-4ed6-a8a3-5c1c303a26f1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:52.870727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:52.875029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:52.876434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:52.877652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] PATH_INFO: `/v3/projects/0dd24ae3ef4a4a6a9e00af4451e227ee` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:52.886757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd24ae3ef4a4a6a9e00af4451e227ee)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:52.900087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 844/1681] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:52 2021] POST /identity/v3/users => generated 298 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:52.907061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:52.908901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:52.973760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b3ee-1919-4c64-886f-c4f4745a48e5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:53.000580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:53.001685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:53.002806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:53.003329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:53.004365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:53.010217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:53.037104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 845/1682] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:52 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:53.043334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:53.066483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db257-89ed-415d-bebe-d9348b4f93cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:53.086056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:53.087462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:53.087967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:53.088447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] PATH_INFO: `/v3/projects/a81e225011134b60951f2759de9ab442/users/d1c197c7f0cd4779a0364404625fde94/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:53.113366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81e225011134b60951f2759de9ab442, user_id=d1c197c7f0cd4779a0364404625fde94, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:53.120727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:53.206266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd24ae3ef4a4a6a9e00af4451e227ee', 'request_id': 'req-698e9268-bc14-4db0-a300-9d642d979d28'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:53.217033 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 846/1683] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:53 2021] PUT /identity/v3/projects/a81e225011134b60951f2759de9ab442/users/d1c197c7f0cd4779a0364404625fde94/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:54:53.222006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:53.274906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd24ae3ef4a4a6a9e00af4451e227ee', 'request_id': 'req-698e9268-bc14-4db0-a300-9d642d979d28'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:53.353127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd24ae3ef4a4a6a9e00af4451e227ee', 'request_id': 'req-698e9268-bc14-4db0-a300-9d642d979d28'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:53.425466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] The token cache is being invalidate because project 0dd24ae3ef4a4a6a9e00af4451e227ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:53.457336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:53.463563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-698e9268-bc14-4db0-a300-9d642d979d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:53.496624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 838/1684] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:52 2021] DELETE /identity/v3/projects/0dd24ae3ef4a4a6a9e00af4451e227ee => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:53.501353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aa43d-710b-4cc1-b64f-2a8ae45cb740 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:53.513732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f500-b05e-49b6-b456-2f49e3c1e9f1 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:53.514849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f500-b05e-49b6-b456-2f49e3c1e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:53.519323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f500-b05e-49b6-b456-2f49e3c1e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:53.635873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1224f500-b05e-49b6-b456-2f49e3c1e9f1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:53.654356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1224f500-b05e-49b6-b456-2f49e3c1e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:53.766437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:53.767880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:53.768370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:53.768842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:53.782673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:53.799302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:53.872341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 847/1685] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:53 2021] GET /identity/v3/roles => generated 1420 bytes in 651 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:53.879135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:53.881823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:53.934543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb602fff-557a-44b0-af6b-25ad60b87230 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:53.955450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4160-aa5b-4f77-93ca-472cf20fd70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:53.956971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4160-aa5b-4f77-93ca-472cf20fd70c admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:53.957431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4160-aa5b-4f77-93ca-472cf20fd70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:53.957910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4160-aa5b-4f77-93ca-472cf20fd70c admin admin] PATH_INFO: `/v3/projects/a81e225011134b60951f2759de9ab442/users/d1c197c7f0cd4779a0364404625fde94/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:53.972870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4160-aa5b-4f77-93ca-472cf20fd70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81e225011134b60951f2759de9ab442, user_id=d1c197c7f0cd4779a0364404625fde94, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:53.978496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4160-aa5b-4f77-93ca-472cf20fd70c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:54.036656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 848/1686] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:53 2021] PUT /identity/v3/projects/a81e225011134b60951f2759de9ab442/users/d1c197c7f0cd4779a0364404625fde94/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:54:54.044607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:54.045317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:54.045917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 839/1687] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:54.046512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:54.049501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:54.053194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:54.058096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:54.140752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] MFA Rules not processed for user `d1c197c7f0cd4779a0364404625fde94`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:54.142407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:54.169406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:54.172262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:54.436816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 840/1688] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:54 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:54.436816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:54.447161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:54.619336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 849/1689] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:54:54.633764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:54.644415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:54.873760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293b183-d7d4-4990-973d-40b757b810f7 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:54.901766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:54.903911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:54.904253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:54.904551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] PATH_INFO: `/v3/projects/1123d21f2250442ba942f58515c7eebe` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:54.920147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfaab6-b235-4ff7-bc25-50f198239deb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:54.928555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:54.931812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:54.932358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:54.932637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:54.933276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=1123d21f2250442ba942f58515c7eebe)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:54.937479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:54.966799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:54.969892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:54.984084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 850/1690] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:54 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:54.985804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:55.024143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9642cc-c3b9-4efc-873a-75a72cd6ca2f service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:55.046195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:55.048895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:55.050440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:55.050807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:55.055011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:55.055467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:55.071340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2ae74-b020-482a-871f-e8a3c589d6d8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:55.120092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1123d21f2250442ba942f58515c7eebe', 'request_id': 'req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.130910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 851/1691] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:55.133336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec20a1-dfab-461b-93d6-15704862fb90 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:55.133727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec20a1-dfab-461b-93d6-15704862fb90 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:55.134104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec20a1-dfab-461b-93d6-15704862fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:55.173775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1123d21f2250442ba942f58515c7eebe', 'request_id': 'req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.218472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1123d21f2250442ba942f58515c7eebe', 'request_id': 'req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.234583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-95ec20a1-dfab-461b-93d6-15704862fb90 None None] MFA Rules not processed for user `9f70acf2d84d44c896f1d284b84fa9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:55.238004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-95ec20a1-dfab-461b-93d6-15704862fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:55.302583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] The token cache is being invalidate because project 1123d21f2250442ba942f58515c7eebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:55.302583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.310993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.313851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 841/1692] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:54 2021] DELETE /identity/v3/projects/1123d21f2250442ba942f58515c7eebe => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:55.314970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:55.322093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:55.395369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 852/1693] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:55 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:55.395369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:55.395369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:55.395369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:55.459651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] MFA Rules not processed for user `ed271ee2a33f484ebb184fd30f99281b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:55.463166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:55.480913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade060-27e9-451b-a0c1-1c1b6b7bb2df admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:55.493942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:55.496538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:55.497716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:55.498112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] PATH_INFO: `/v3/users/ac902890430b4722b22d320e85187a8e` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:55.500875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac902890430b4722b22d320e85187a8e)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:55.506249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:55.644634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac902890430b4722b22d320e85187a8e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.645780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac902890430b4722b22d320e85187a8e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.649528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac902890430b4722b22d320e85187a8e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.661864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 853/1694] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:55 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:55.662804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:55.665006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:55.668499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac902890430b4722b22d320e85187a8e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.694927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac902890430b4722b22d320e85187a8e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:55.707523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d691cdc-4dfc-4019-985d-7c193a77e707 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:55.719568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d13d6-e9a2-4451-9d79-772d7e3c7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:55.722104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d13d6-e9a2-4451-9d79-772d7e3c7c48 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:55.722611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d13d6-e9a2-4451-9d79-772d7e3c7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:55.724032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d13d6-e9a2-4451-9d79-772d7e3c7c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:55.726058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d13d6-e9a2-4451-9d79-772d7e3c7c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:55.732664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 842/1695] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:55 2021] DELETE /identity/v3/users/ac902890430b4722b22d320e85187a8e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:55.732900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d13d6-e9a2-4451-9d79-772d7e3c7c48 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:55.733009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:55.734021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:55.806847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 854/1696] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:55 2021] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:55.808451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:55.810822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:55.811937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:55.870873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] MFA Rules not processed for user `2ecc2dca57d045869f1fcf3a4337b990`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:55.872585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:55.905436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1480-26d1-479d-b87d-eb26be5e4ae4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:56.011535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 855/1697] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Nov 10 15:54:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:56.012585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:56.015195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.117492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:56.119189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.119622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.120260 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] PATH_INFO: `/v3/projects/593e338ca89740889af4acdd9bc4e4d5` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.127035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593e338ca89740889af4acdd9bc4e4d5)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:56.130563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:56.153646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b8b25-da75-40ea-bae9-58062aa842fc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:56.176081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:56.179646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.180248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.181218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] PATH_INFO: `/v3/users/e96b259944a44c7bb8c66df16448377f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.196254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96b259944a44c7bb8c66df16448377f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:56.199670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:56.305743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593e338ca89740889af4acdd9bc4e4d5', 'request_id': 'req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.325796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593e338ca89740889af4acdd9bc4e4d5', 'request_id': 'req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.338972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593e338ca89740889af4acdd9bc4e4d5', 'request_id': 'req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.343592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96b259944a44c7bb8c66df16448377f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.344508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96b259944a44c7bb8c66df16448377f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.347506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96b259944a44c7bb8c66df16448377f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.366252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96b259944a44c7bb8c66df16448377f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.377428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] The token cache is being invalidate because project 593e338ca89740889af4acdd9bc4e4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:56.377737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.378936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f9d7be6a-5042-4f7c-adfe-4a6c0f22dbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.381813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 843/1698] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:55 2021] DELETE /identity/v3/projects/593e338ca89740889af4acdd9bc4e4d5 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:56.383390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6e4a-999d-4214-aeb3-898a04c37ff3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.383679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6e4a-999d-4214-aeb3-898a04c37ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.384719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6e4a-999d-4214-aeb3-898a04c37ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.400132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96b259944a44c7bb8c66df16448377f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:56.441322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a51e6e4a-999d-4214-aeb3-898a04c37ff3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:56.450053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a51e6e4a-999d-4214-aeb3-898a04c37ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.451292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 856/1699] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:56 2021] DELETE /identity/v3/users/e96b259944a44c7bb8c66df16448377f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:56.454104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:56.457270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.631347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 844/1700] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:56.639312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf326b1-7c32-4a10-808b-8769f81b9851 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.640051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf326b1-7c32-4a10-808b-8769f81b9851 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.640405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf326b1-7c32-4a10-808b-8769f81b9851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.699240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc28fd-2ac9-46cc-88f8-25b8769faf9b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:56.700140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ccf326b1-7c32-4a10-808b-8769f81b9851 None None] MFA Rules not processed for user `ed271ee2a33f484ebb184fd30f99281b`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:56.703581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ccf326b1-7c32-4a10-808b-8769f81b9851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.714690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:56.715402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.715673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.715959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.721250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.807290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 845/1701] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:56 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:56.820198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.820554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.820772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.859361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:56.860626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.872213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 846/1702] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:56.876836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:56.878585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.891539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789174-1d5a-4b8f-b924-1e9d03359af7 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:56.895493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:56.901414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:56.908569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91733df-66d0-48ee-b978-8a839d3a35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:56.909806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91733df-66d0-48ee-b978-8a839d3a35a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.910230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91733df-66d0-48ee-b978-8a839d3a35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.910813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91733df-66d0-48ee-b978-8a839d3a35a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.911971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91733df-66d0-48ee-b978-8a839d3a35a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:56.916220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91733df-66d0-48ee-b978-8a839d3a35a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:56.925532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 857/1703] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:56.927542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:56.936149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:56.965455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 847/1704] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:56 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:56.970317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e292-56ed-435c-9cda-1ee8fe5f1fa2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.970895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e292-56ed-435c-9cda-1ee8fe5f1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.971320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e292-56ed-435c-9cda-1ee8fe5f1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.973655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605c729-b21c-4c2f-aeda-9b7516b87ecb service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:56.988744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:56.989803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:56.990102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:56.990374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] PATH_INFO: `/v3/users/84ab617493724926a54880d16a3a924b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:56.994104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ab617493724926a54880d16a3a924b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:56.996730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.003085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-e1b9e292-56ed-435c-9cda-1ee8fe5f1fa2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:57.004660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e1b9e292-56ed-435c-9cda-1ee8fe5f1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.034053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 848/1705] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:57.035938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.036336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.044445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.097419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:57.101723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.131640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 849/1706] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:57.131640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.133253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.141280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ab617493724926a54880d16a3a924b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:57.142323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ab617493724926a54880d16a3a924b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:57.142774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ab617493724926a54880d16a3a924b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:57.158022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ab617493724926a54880d16a3a924b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:57.186205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ab617493724926a54880d16a3a924b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:57.208540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837543-d9e3-40d0-808e-dcc37ee6b970 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.219310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.219310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.219310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.219310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.221145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 858/1707] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:54:56 2021] DELETE /identity/v3/users/84ab617493724926a54880d16a3a924b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:57.224462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.228004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.241042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.298144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.310272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.353378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 850/1708] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:57.354319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.364656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.422375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a27a3-9dd0-4ce9-b915-38660c61fb92 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.473638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc982dd1-9d84-4717-bb9e-bae256bfb692 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.481884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.491153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.492181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.492694 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.497060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.617081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.618012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.618372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.618656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.619487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.621386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.655894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 851/1709] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:57.657222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.675589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205550-6695-4b86-b32e-8231c07987c9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.688349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.689038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.689321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.689596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.696946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.721203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.722773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.733119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.735738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.753613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 859/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:57.755735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.757830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.770630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 852/1711] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:57.771681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.775616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ddcc-4877-49da-9b74-71ea8653c315 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.782098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.783038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.784100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.785091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.785774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.786833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:54:57.787380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.789980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.818002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b6389-5f76-49cf-9133-7bd7f91fb9dd service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.829787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 860/1712] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:54:57.831431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.840707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.841406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.841905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.842022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.849026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:57.852148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb173b6-59fe-418a-a71e-92bdd3994dd8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.860724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.862552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.865895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.866447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.867476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.869566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.890976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 861/1713] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:57.891309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.892431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.893520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.909152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293febcb-9752-405f-9fc2-70ec7baf2bd1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.916579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.918213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:57.918736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:57.919231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:57.920215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:57.925112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:57.934715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 853/1714] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:54:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:54:57.935617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:57.977809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fdc4c-bc50-4c9b-a042-26d3702ffe22 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:57.998932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a26d90-66f0-479d-ac48-a16570fccbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:57.999806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a26d90-66f0-479d-ac48-a16570fccbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:58.000142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a26d90-66f0-479d-ac48-a16570fccbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:58.000366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a26d90-66f0-479d-ac48-a16570fccbfe admin admin] PATH_INFO: `/v3/projects/cae9c614a1444ecf9872e6a953f8a4c2/users/a8b697167a3d4022b32d5316af5233e3/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:58.016005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 862/1715] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:57 2021] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:58.018773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:58.068984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a26d90-66f0-479d-ac48-a16570fccbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae9c614a1444ecf9872e6a953f8a4c2, user_id=a8b697167a3d4022b32d5316af5233e3, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:58.072051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a26d90-66f0-479d-ac48-a16570fccbfe admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:58.120163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 854/1716] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:57 2021] PUT /identity/v3/projects/cae9c614a1444ecf9872e6a953f8a4c2/users/a8b697167a3d4022b32d5316af5233e3/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:58.144600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:58.145178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:58.145606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:58.237139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] MFA Rules not processed for user `a8b697167a3d4022b32d5316af5233e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:58.238524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:58.347494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5628-2487-46bd-a059-155bbdaba7c6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:58.430478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 855/1717] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:58.435588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:58.517132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:58.518860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:58.521988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:58.522232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:58.524458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:58.535507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:58.593475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 863/1718] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:58 2021] POST /identity/v3/users => generated 302 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:58.594913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:58.627913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fd111-ea96-4bb9-a663-e6212846a3b0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:58.628180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a513b95-f01f-49a6-b2ea-c4396d4ea11b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:58.637547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:58.638236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:58.640463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:58.641219 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:58.641644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:58.642050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:58.642492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:58.643014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:58.647005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:58.647236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:58.650556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:58.652734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:58.687530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 864/1719] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:58 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:58.690610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:58.696340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:58.726631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 856/1720] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:54:58 2021] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:58.726631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:58.736037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0fd8-401e-460c-b78d-144b59fd8841 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:58.895622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:58.896721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:58.897018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:58.897348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] PATH_INFO: `/v3/projects/cdf330b17d224c68b9b5ddb8a16eb272` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:58.902189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf330b17d224c68b9b5ddb8a16eb272)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:58.903270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING py.warnings [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 10 15:54:58.903270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: warnings.warn(msg) Nov 10 15:54:58.903270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: Nov 10 15:54:58.914874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:58.985703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb98af-0e3b-4fc0-ac96-1bc3fd362f0a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:59.013542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:59.016273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.017140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.017425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.020235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:59.025791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:59.053852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf330b17d224c68b9b5ddb8a16eb272', 'request_id': 'req-d531fceb-37a8-48e9-8344-b7f6b3591b07'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:59.069144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 857/1721] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:58 2021] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:59.073808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf330b17d224c68b9b5ddb8a16eb272', 'request_id': 'req-d531fceb-37a8-48e9-8344-b7f6b3591b07'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:59.082863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf330b17d224c68b9b5ddb8a16eb272', 'request_id': 'req-d531fceb-37a8-48e9-8344-b7f6b3591b07'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:59.084564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:59.112270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] The token cache is being invalidate because project cdf330b17d224c68b9b5ddb8a16eb272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:54:59.112573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:59.113415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:54:59.116262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 865/1722] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:54:58 2021] DELETE /identity/v3/projects/cdf330b17d224c68b9b5ddb8a16eb272 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:59.117256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:59.122359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f5de-3d28-42c0-a7de-045b3c236b0c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:59.124571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:59.361863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d40b-d45b-41e3-9656-c1faf8cec248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:59.362619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d40b-d45b-41e3-9656-c1faf8cec248 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.362977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d40b-d45b-41e3-9656-c1faf8cec248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.363352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d40b-d45b-41e3-9656-c1faf8cec248 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.364555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d40b-d45b-41e3-9656-c1faf8cec248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:59.367573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d40b-d45b-41e3-9656-c1faf8cec248 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:59.396338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531fceb-37a8-48e9-8344-b7f6b3591b07 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:59.434985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 858/1723] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:54:59 2021] POST /identity/v3/users => generated 299 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:54:59.434985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338024f-620a-403e-977c-daf99dccc83b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.435274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338024f-620a-403e-977c-daf99dccc83b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.435346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338024f-620a-403e-977c-daf99dccc83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.436292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b53f2e-fb99-4a40-8752-acb404a30d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:59.441580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b53f2e-fb99-4a40-8752-acb404a30d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.441776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b53f2e-fb99-4a40-8752-acb404a30d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.443126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b53f2e-fb99-4a40-8752-acb404a30d89 admin admin] PATH_INFO: `/v3/projects/1dcaeb49de794c1885b755a4556a5e14/users/b363378af33743629e7c9ba6ca9e236b/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.489589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c338024f-620a-403e-977c-daf99dccc83b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:59.494014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c338024f-620a-403e-977c-daf99dccc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:59.505467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 859/1724] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:59.506335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338024f-620a-403e-977c-daf99dccc83b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:59.512457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c338024f-620a-403e-977c-daf99dccc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:59.512933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b53f2e-fb99-4a40-8752-acb404a30d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcaeb49de794c1885b755a4556a5e14, user_id=b363378af33743629e7c9ba6ca9e236b, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:59.522586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b53f2e-fb99-4a40-8752-acb404a30d89 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:59.550476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 866/1725] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:59 2021] PUT /identity/v3/projects/1dcaeb49de794c1885b755a4556a5e14/users/b363378af33743629e7c9ba6ca9e236b/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:54:59.551999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.552289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.552567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.598917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:54:59.602060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:54:59.610836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338024f-620a-403e-977c-daf99dccc83b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:59.811017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cda518-13b5-4876-8b50-b72d0c0ce2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:59.812552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cda518-13b5-4876-8b50-b72d0c0ce2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.813052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cda518-13b5-4876-8b50-b72d0c0ce2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.814002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cda518-13b5-4876-8b50-b72d0c0ce2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.815652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cda518-13b5-4876-8b50-b72d0c0ce2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:54:59.819784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cda518-13b5-4876-8b50-b72d0c0ce2f5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:54:59.869250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 860/1726] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:54:59 2021] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:54:59.869250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.869250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.869250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.894664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 867/1727] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:54:59.916424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:54:59.943268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dac03-5c3b-4154-a656-f84c1f2eed90 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:54:59.959841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:54:59.960778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:54:59.961228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:54:59.961692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] PATH_INFO: `/v3/projects/ba5dfa63496740a49a4f11c36133a7d7/users/e196e6e326954830b129ee59498747b9/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:54:59.996542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] MFA Rules not processed for user `b363378af33743629e7c9ba6ca9e236b`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:00.006538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:00.009178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5dfa63496740a49a4f11c36133a7d7, user_id=e196e6e326954830b129ee59498747b9, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:00.013252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:00.059803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 868/1728] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:54:59 2021] PUT /identity/v3/projects/ba5dfa63496740a49a4f11c36133a7d7/users/e196e6e326954830b129ee59498747b9/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:00.060991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:00.249628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 861/1729] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:54:59 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:00.251002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:00.277093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6351b2-5fb1-4463-af63-e54299945cfa None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:00.436755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050d715-0195-43e5-8e16-bf1209b8a9e5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:00.470115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:00.472458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:00.474909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:00.478777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:00.491476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:00.495026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:00.500108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:00.524005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:00.527726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:00.528496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:00.529145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:00.539610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:00.541503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:00.567015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 862/1730] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:00 2021] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:00.568463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:00.584911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6cf3c-022c-4ee8-aa19-810af6af8dad admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:00.585336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 869/1731] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:00.589062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:00.604006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:00.604740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:00.606296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:00.606663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:00.607469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:00.611661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:00.619941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa872b-635c-40fe-8623-233c69ca8bbf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:00.643555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:00.646089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:00.646861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:00.647779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] PATH_INFO: `/v3/projects/ba5dfa63496740a49a4f11c36133a7d7/users/e196e6e326954830b129ee59498747b9/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:00.671795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5dfa63496740a49a4f11c36133a7d7, user_id=e196e6e326954830b129ee59498747b9, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:00.679866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:00.705763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 863/1732] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:00 2021] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:00.705763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:00.709024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 870/1733] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:00 2021] PUT /identity/v3/projects/ba5dfa63496740a49a4f11c36133a7d7/users/e196e6e326954830b129ee59498747b9/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:00.745246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:01.003311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82457572-a00c-4047-a4d6-abb9916207c1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:01.020673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33aae34-9909-4651-99d1-019d63cc1964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:01.021541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aae34-9909-4651-99d1-019d63cc1964 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.021830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aae34-9909-4651-99d1-019d63cc1964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.022115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aae34-9909-4651-99d1-019d63cc1964 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.022975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aae34-9909-4651-99d1-019d63cc1964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:01.027998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aae34-9909-4651-99d1-019d63cc1964 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:01.060479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59665b-1527-46cd-9971-66691c46aa43 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:01.080396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746877-5505-4da9-b710-256f474887b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:01.081647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746877-5505-4da9-b710-256f474887b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.083218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746877-5505-4da9-b710-256f474887b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.083835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746877-5505-4da9-b710-256f474887b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.084491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 871/1734] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:00 2021] POST /identity/v3/users => generated 309 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:01.085653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746877-5505-4da9-b710-256f474887b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:01.088630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.088925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.091220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746877-5505-4da9-b710-256f474887b1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:01.093676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.172179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 864/1735] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:00 2021] POST /identity/v3/projects => generated 357 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:01.187182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30f075-63a4-41ee-8db3-564c596aec97 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.188441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30f075-63a4-41ee-8db3-564c596aec97 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.188954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30f075-63a4-41ee-8db3-564c596aec97 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.206735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 865/1736] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:55:01 2021] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:55:01.208346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30f075-63a4-41ee-8db3-564c596aec97 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:01.278833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] MFA Rules not processed for user `e196e6e326954830b129ee59498747b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:01.280522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:01.509284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30f075-63a4-41ee-8db3-564c596aec97 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:01.532692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f13a3-654e-49bb-8a3b-636129686665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:01.533512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f13a3-654e-49bb-8a3b-636129686665 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.533858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f13a3-654e-49bb-8a3b-636129686665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.534194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f13a3-654e-49bb-8a3b-636129686665 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.536824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f13a3-654e-49bb-8a3b-636129686665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:01.543003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f13a3-654e-49bb-8a3b-636129686665 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:01.604909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 866/1737] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:01 2021] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:01.607149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.607685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.609122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.620856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 872/1738] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:01 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 536 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:01.622640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:01.671753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15244167-f0ec-454d-8a9f-51a98cd502b7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:01.675160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] MFA Rules not processed for user `ed271ee2a33f484ebb184fd30f99281b`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:01.680058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:01.686735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb329dc0-427c-4b79-b6e2-8d64687a2ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:01.687571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb329dc0-427c-4b79-b6e2-8d64687a2ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.687956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb329dc0-427c-4b79-b6e2-8d64687a2ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.688351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb329dc0-427c-4b79-b6e2-8d64687a2ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.689313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb329dc0-427c-4b79-b6e2-8d64687a2ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:01.694708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb329dc0-427c-4b79-b6e2-8d64687a2ee8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:01.776176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 873/1739] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:01 2021] POST /identity/v3/users => generated 279 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:01.778780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:01.793667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:01.794124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:01.870334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:01.883292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:01.958829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 867/1740] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:01 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:01.958829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:02.031483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfc53-b321-486e-bad5-e01e91c509b6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:02.061434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:02.065818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:02.067155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:02.069107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] PATH_INFO: `/v3/projects/9b918052fa924fdfb2f20297fb0c3519/users/75847170daed44cd9a05ef34e22a7dd3/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:02.158895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b918052fa924fdfb2f20297fb0c3519, user_id=75847170daed44cd9a05ef34e22a7dd3, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:02.165425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:02.226578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 868/1741] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:01 2021] PUT /identity/v3/projects/9b918052fa924fdfb2f20297fb0c3519/users/75847170daed44cd9a05ef34e22a7dd3/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:02.229735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:02.255634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:02.295549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 874/1742] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:55:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:02.296658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:02.333051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca410e30-6ef3-4e61-9d69-4292af134315 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:02.529288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:02.530226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:02.530548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:02.530804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:02.532420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:02.537909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:02.544448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306aa4-6316-4506-8bc7-13f52ce00a4f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:02.556720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:02.557617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:02.557902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:02.558194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:02.561085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 875/1743] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:02 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:02.562018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:02.571619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:02.617632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9f25a-2420-43dd-af9e-ad600e5f918f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:02.625792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:02.626734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:02.627220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:02.627673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] PATH_INFO: `/v3/projects/e092e667dc27433c9f34a26988999478` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:02.629962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e092e667dc27433c9f34a26988999478)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:02.634779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:02.752101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:02.759572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:02.797847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e092e667dc27433c9f34a26988999478', 'request_id': 'req-8d966459-8d2b-4cd5-940d-0edca4b4e006'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:02.802216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 869/1744] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:02 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:02.803238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:02.839731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e092e667dc27433c9f34a26988999478', 'request_id': 'req-8d966459-8d2b-4cd5-940d-0edca4b4e006'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:02.868041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d5a4-7d6a-4efd-824e-f714e855617e service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:02.873801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e092e667dc27433c9f34a26988999478', 'request_id': 'req-8d966459-8d2b-4cd5-940d-0edca4b4e006'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:02.911268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] The token cache is being invalidate because project e092e667dc27433c9f34a26988999478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:02.911892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:02.913968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:02.918931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 876/1745] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:02 2021] DELETE /identity/v3/projects/e092e667dc27433c9f34a26988999478 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:02.920080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:02.923720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.036563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:03.037279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:03.037562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:03.037840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:03.038674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:03.040390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:03.054217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 870/1746] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:02 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:03.054217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:03.059075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.084938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6d34-6834-4449-8d49-9c48ae128d44 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:03.100755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:03.101480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:03.101762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:03.102038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:03.102853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:03.104559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:03.134647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 871/1747] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:03 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:03.134647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:03.140409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.148194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d966459-8d2b-4cd5-940d-0edca4b4e006 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:03.157491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:03.158517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:03.159005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:03.159814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:03.163039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.168102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b38d5-27cf-44cb-8694-f8f09155f0f0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:03.182380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:03.184396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:03.188609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:03.189772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:03.190007 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:03.190319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] PATH_INFO: `/v3/projects/67316d1933764478b6e2d223b58f9e3a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:03.193359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67316d1933764478b6e2d223b58f9e3a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:03.195618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:03.217812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 877/1748] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:03.220742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:03.225200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.297875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1091-b12b-4d55-8ab8-d96d2d9c5346 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:03.341665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:03.342870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:03.343194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:03.343606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] PATH_INFO: `/v3/users/a8b697167a3d4022b32d5316af5233e3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:03.358058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b697167a3d4022b32d5316af5233e3)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:03.385547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67316d1933764478b6e2d223b58f9e3a', 'request_id': 'req-566d98ac-e2ec-445a-b473-df1cc7301917'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.386079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:03.453621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67316d1933764478b6e2d223b58f9e3a', 'request_id': 'req-566d98ac-e2ec-445a-b473-df1cc7301917'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.475168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67316d1933764478b6e2d223b58f9e3a', 'request_id': 'req-566d98ac-e2ec-445a-b473-df1cc7301917'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.545713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] The token cache is being invalidate because project 67316d1933764478b6e2d223b58f9e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:03.546464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.548798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.567973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 872/1749] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:03 2021] DELETE /identity/v3/projects/67316d1933764478b6e2d223b58f9e3a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:03.568976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:03.572256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b697167a3d4022b32d5316af5233e3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.573518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.574010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b697167a3d4022b32d5316af5233e3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.579126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b697167a3d4022b32d5316af5233e3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.606278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b697167a3d4022b32d5316af5233e3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.661894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b697167a3d4022b32d5316af5233e3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:03.738615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 878/1750] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:03 2021] DELETE /identity/v3/users/a8b697167a3d4022b32d5316af5233e3 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:03.739852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:03.752907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:03.893769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d98ac-e2ec-445a-b473-df1cc7301917 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:04.036824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53b2c-ded9-40f9-9f61-5ba2defd2914 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:04.116602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:04.123521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.124642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:04.125633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.125926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.139686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] PATH_INFO: `/v3/projects/9b918052fa924fdfb2f20297fb0c3519/users/75847170daed44cd9a05ef34e22a7dd3/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.140328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.142707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] PATH_INFO: `/v3/users/d1c197c7f0cd4779a0364404625fde94` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.145044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c197c7f0cd4779a0364404625fde94)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:04.148294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:04.148509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b918052fa924fdfb2f20297fb0c3519, user_id=75847170daed44cd9a05ef34e22a7dd3, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:04.175028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:04.240550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 879/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:03 2021] PUT /identity/v3/projects/9b918052fa924fdfb2f20297fb0c3519/users/75847170daed44cd9a05ef34e22a7dd3/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:04.257942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:04.272326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:04.428893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c197c7f0cd4779a0364404625fde94'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:04.432606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c197c7f0cd4779a0364404625fde94'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:04.436218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c197c7f0cd4779a0364404625fde94'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:04.473231 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c197c7f0cd4779a0364404625fde94'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:04.524924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-522e5e53-ec96-4e46-9606-3d50cfc6a6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c197c7f0cd4779a0364404625fde94'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:04.617053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 873/1752] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:03 2021] DELETE /identity/v3/users/d1c197c7f0cd4779a0364404625fde94 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:04.628295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8a32-a813-45a9-a018-f4675da25043 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.628807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8a32-a813-45a9-a018-f4675da25043 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.629322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8a32-a813-45a9-a018-f4675da25043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.666349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fc1ba-57dd-4e0c-91bc-c9406dff579c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:04.686603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f3ff8a32-a813-45a9-a018-f4675da25043 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:04.693644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f3ff8a32-a813-45a9-a018-f4675da25043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:04.844396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca62e0-a8a4-4e14-a26d-5944ba2ab5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:04.845592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca62e0-a8a4-4e14-a26d-5944ba2ab5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.845883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca62e0-a8a4-4e14-a26d-5944ba2ab5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.846390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca62e0-a8a4-4e14-a26d-5944ba2ab5dd admin admin] PATH_INFO: `/v3/projects/030370758a4849bd85a0181896d41bad/users/88e846b438d84519982780b1adb42b5f/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.880674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 874/1753] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:04.882785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc5a19-ce8a-4742-ba59-bef1cd4f7a5f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.883543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc5a19-ce8a-4742-ba59-bef1cd4f7a5f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.884229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc5a19-ce8a-4742-ba59-bef1cd4f7a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.885127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca62e0-a8a4-4e14-a26d-5944ba2ab5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=030370758a4849bd85a0181896d41bad, user_id=88e846b438d84519982780b1adb42b5f, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:04.897165 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca62e0-a8a4-4e14-a26d-5944ba2ab5dd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:04.907760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0ffc5a19-ce8a-4742-ba59-bef1cd4f7a5f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:04.909936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0ffc5a19-ce8a-4742-ba59-bef1cd4f7a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:04.922618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 875/1754] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:04.922618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d570e8-441c-4722-b0f0-2d6983bc55fa None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.930827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d570e8-441c-4722-b0f0-2d6983bc55fa None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.930827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d570e8-441c-4722-b0f0-2d6983bc55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.941054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 880/1755] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:04 2021] PUT /identity/v3/projects/030370758a4849bd85a0181896d41bad/users/88e846b438d84519982780b1adb42b5f/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:04.945951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:04.947120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:04.947924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:04.991994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f3d570e8-441c-4722-b0f0-2d6983bc55fa None None] MFA Rules not processed for user `75847170daed44cd9a05ef34e22a7dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:04.993504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f3d570e8-441c-4722-b0f0-2d6983bc55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:05.006449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:05.016821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:05.091441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 876/1756] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:04 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:05.109401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:05.110652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:05.110652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:05.185315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] MFA Rules not processed for user `88e846b438d84519982780b1adb42b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:05.187000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:05.370031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 877/1757] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:05 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:05.375159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:05.383913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:05.438642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 881/1758] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:05.453277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:05.471907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:05.555760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9822-355c-48d3-b187-c0a66420fd31 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:05.568509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:05.568993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:05.569336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:05.569710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:05.606328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:05.607999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:05.664465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 878/1759] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:05.665233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:05.670451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:05.704092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1de97-fbf8-425d-b6a3-a5bc115a95e8 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:05.714220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:05.714937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:05.715222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:05.715501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:05.716906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:05.719811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:05.761177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 879/1760] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:05 2021] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:05.766263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:05.854741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a51d-dd9a-4873-8ea2-c28f76986aac admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:05.860289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:05.861321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:05.861513 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:05.861764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:05.872458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:05.872458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:05.872458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:05.892297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 880/1761] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:05.892297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:05.903726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9394c4e-68b4-4f40-b0d8-ff67fdb4d3f3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:05.910620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:05.911490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:05.911778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:05.912127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:05.912950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:05.915333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031e5e-ac99-43b3-94d4-7c68560d06b8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:05.915906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:05.962762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 881/1762] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:05 2021] POST /identity/v3/users => generated 284 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:05.963771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:05.988400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d10d6-9b57-457f-924f-40d05f17b31e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:06.002877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.003628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.003913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.004192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.008597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.015685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:06.091642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 882/1763] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:05 2021] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:06.093573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:06.111238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.116086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.116873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.117462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.363885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230fc1-daff-4b62-b61a-d5995e0e0805 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:06.382373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.383690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.384677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.386986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:06.387654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.387867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.388808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.396517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:06.410767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 882/1764] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:05 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 975 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:06.412253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:06.432323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8f4fe-e9b6-4ee3-afa5-e75d190e4fc1 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:06.438789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 883/1765] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:06 2021] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:06.457247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:06.464356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.472292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.473092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.474096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.475197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.477364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:06.497228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736276bb-c0cd-4ddd-a420-3df7174777c1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:06.516889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 883/1766] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:06 2021] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:06.519638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:06.528935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.529942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.530365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.530662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] PATH_INFO: `/v3/projects/27edc238db0f411b954a3dec0421266c/users/38d7927857f94bc49f24bf1429fdc651/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.574972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029501c-bfeb-40a7-b1a1-fe05c4dc12e0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:06.593699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.594476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.594768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.595141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.598428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.611929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:06.652598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27edc238db0f411b954a3dec0421266c, user_id=38d7927857f94bc49f24bf1429fdc651, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.655510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 884/1767] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:06 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:06.690096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:06.694725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:06.735545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 884/1768] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:06 2021] PUT /identity/v3/projects/27edc238db0f411b954a3dec0421266c/users/38d7927857f94bc49f24bf1429fdc651/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:06.740383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:06.752388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c88ab8-3b83-4a16-b52b-b757a8807b09 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:06.964176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:06.965073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:06.969732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:06.970310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:06.972498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:06.976603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.000185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadad4b-cd53-4a64-b1e2-e6b64c08df0b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:07.016478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:07.017198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.017490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.017759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.023756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:07.023970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 885/1769] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:06 2021] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:07.027471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:07.033868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.035166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.056631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 885/1770] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:06 2021] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:55:07.057850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:07.061712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.081236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f385-9372-46e4-8bc6-2fc1991eb7b1 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:07.101361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:07.102444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.102669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.102953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] PATH_INFO: `/v3/users/b363378af33743629e7c9ba6ca9e236b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.104783 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b363378af33743629e7c9ba6ca9e236b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:07.106912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.110768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1444c-fa09-46f4-b63c-cf2bbcb3a141 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:07.118869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:07.120257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.120683 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.122581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] PATH_INFO: `/v3/projects/a81e225011134b60951f2759de9ab442` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.124218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81e225011134b60951f2759de9ab442)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:07.128914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.228159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b363378af33743629e7c9ba6ca9e236b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.229913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b363378af33743629e7c9ba6ca9e236b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.231820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81e225011134b60951f2759de9ab442', 'request_id': 'req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.232367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b363378af33743629e7c9ba6ca9e236b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.247403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b363378af33743629e7c9ba6ca9e236b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.256078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81e225011134b60951f2759de9ab442', 'request_id': 'req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.264768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81e225011134b60951f2759de9ab442', 'request_id': 'req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.268230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b363378af33743629e7c9ba6ca9e236b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.280463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] The token cache is being invalidate because project a81e225011134b60951f2759de9ab442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:07.280949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.281545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.289606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 886/1771] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:07 2021] DELETE /identity/v3/projects/a81e225011134b60951f2759de9ab442 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:07.291273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:07.293588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.309553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 886/1772] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:07 2021] DELETE /identity/v3/users/b363378af33743629e7c9ba6ca9e236b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:07.312407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:07.319791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.433803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5ed0-c33c-4247-8fe1-4b8ba70acd43 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:07.440468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a1680-430f-488d-9c6a-fcd2590663c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:07.442070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1680-430f-488d-9c6a-fcd2590663c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.442619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1680-430f-488d-9c6a-fcd2590663c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.443117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1680-430f-488d-9c6a-fcd2590663c4 admin admin] PATH_INFO: `/v3/projects/69cdeaa36fd3489bbf6aed24739e4817/users/43c5e2b806a14d42ae89af7b4acccee9/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.456150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ea064-27b2-445b-ab97-d03779341d4c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:07.466112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746be60-2f0d-4a89-b2e2-d06f5ca5dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:07.467439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746be60-2f0d-4a89-b2e2-d06f5ca5dd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.467728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746be60-2f0d-4a89-b2e2-d06f5ca5dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.468020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746be60-2f0d-4a89-b2e2-d06f5ca5dd5d admin admin] PATH_INFO: `/v3/projects/27edc238db0f411b954a3dec0421266c/users/38d7927857f94bc49f24bf1429fdc651/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.470915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746be60-2f0d-4a89-b2e2-d06f5ca5dd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27edc238db0f411b954a3dec0421266c, user_id=38d7927857f94bc49f24bf1429fdc651, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:07.472112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a1680-430f-488d-9c6a-fcd2590663c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cdeaa36fd3489bbf6aed24739e4817, user_id=43c5e2b806a14d42ae89af7b4acccee9, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:07.473897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746be60-2f0d-4a89-b2e2-d06f5ca5dd5d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.487576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 887/1773] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:07 2021] PUT /identity/v3/projects/27edc238db0f411b954a3dec0421266c/users/38d7927857f94bc49f24bf1429fdc651/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:07.489136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.489422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.489702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.491381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a1680-430f-488d-9c6a-fcd2590663c4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.528426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 887/1774] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:07 2021] PUT /identity/v3/projects/69cdeaa36fd3489bbf6aed24739e4817/users/43c5e2b806a14d42ae89af7b4acccee9/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:07.529983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a85fb-f189-44a4-bb27-5175995da8d3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.530314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a85fb-f189-44a4-bb27-5175995da8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.530573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a85fb-f189-44a4-bb27-5175995da8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.556643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1c1a85fb-f189-44a4-bb27-5175995da8d3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:07.557532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:07.557948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1c1a85fb-f189-44a4-bb27-5175995da8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.559741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.691919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 888/1775] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:07.692642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:07.694370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.698355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 888/1776] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:07.703155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3729-2428-4e0a-8b48-7b5beaba9626 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.704717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3729-2428-4e0a-8b48-7b5beaba9626 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.704717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3729-2428-4e0a-8b48-7b5beaba9626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.712843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3e41-36b1-47a1-9c4b-b62df4b6ca49 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:07.718234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:07.718898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.719184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.719487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] PATH_INFO: `/v3/projects/cae9c614a1444ecf9872e6a953f8a4c2` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.720911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae9c614a1444ecf9872e6a953f8a4c2)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:07.723077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:07.774252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c00f3729-2428-4e0a-8b48-7b5beaba9626 None None] MFA Rules not processed for user `38d7927857f94bc49f24bf1429fdc651`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:07.776251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c00f3729-2428-4e0a-8b48-7b5beaba9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.794642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae9c614a1444ecf9872e6a953f8a4c2', 'request_id': 'req-99033e1b-67e3-43c5-9979-de321b44d58f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.804340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae9c614a1444ecf9872e6a953f8a4c2', 'request_id': 'req-99033e1b-67e3-43c5-9979-de321b44d58f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.814605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae9c614a1444ecf9872e6a953f8a4c2', 'request_id': 'req-99033e1b-67e3-43c5-9979-de321b44d58f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.839143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] The token cache is being invalidate because project cae9c614a1444ecf9872e6a953f8a4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:07.839559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.840372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-99033e1b-67e3-43c5-9979-de321b44d58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:07.843182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 889/1777] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:07 2021] DELETE /identity/v3/projects/cae9c614a1444ecf9872e6a953f8a4c2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:07.848530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.848816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.849086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.867070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 889/1778] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:07 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:07.868760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35333cc-1883-41e7-a598-8de7920998d5 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.869116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35333cc-1883-41e7-a598-8de7920998d5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.869458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35333cc-1883-41e7-a598-8de7920998d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.891355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] MFA Rules not processed for user `43c5e2b806a14d42ae89af7b4acccee9`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:07.894002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.894560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f35333cc-1883-41e7-a598-8de7920998d5 None None] MFA Rules not processed for user `9f70acf2d84d44c896f1d284b84fa9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:07.896640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f35333cc-1883-41e7-a598-8de7920998d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:07.971549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 890/1779] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:07 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:07.972857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:07.973141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:07.974891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:07.998556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:07.998842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 890/1780] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:07.999681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.003305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.006454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.097637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab574c-1aae-4aff-a102-145b546a38f7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.104435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.104435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.104435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.104435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.106960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.144953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 891/1781] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:08.148929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.153069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.174339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23496-b599-4d66-95ca-d9a9cb84202e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.181065 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.182418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.184302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.184690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] PATH_INFO: `/v3/users/e196e6e326954830b129ee59498747b9` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.186654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e196e6e326954830b129ee59498747b9)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.189141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.213745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.215655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.228987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 891/1782] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:08.230390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.231981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.264314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e196e6e326954830b129ee59498747b9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:08.265595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e196e6e326954830b129ee59498747b9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:08.269258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e196e6e326954830b129ee59498747b9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:08.283538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e196e6e326954830b129ee59498747b9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:08.303503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e196e6e326954830b129ee59498747b9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:08.319666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 892/1783] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:08 2021] DELETE /identity/v3/users/e196e6e326954830b129ee59498747b9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:08.320565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.322011 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.352878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ae69-f1ac-45c3-b2d3-0700ddfc2360 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.418650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.420557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.421305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.421820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.425137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.434677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1064-541a-4bf4-943d-ce00df509c71 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.454740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.455577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.455864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.456150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.458530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.460628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.505467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 893/1784] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:08 2021] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:08.507591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.510002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.576448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.582037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.598469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 892/1785] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:08 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:08.599644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.618511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776782-f8cc-498e-9f0a-e7cac138d8e5 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.657949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981ef3e-3712-45a7-86c1-8fd5d2b3db0b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.679507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.680731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.681110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.681480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.683305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:08.683787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.685805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.719889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 894/1786] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:08.722311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.726249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.748463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.749604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.750114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.750685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.751772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.754744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.792009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 893/1787] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:08 2021] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:08.793320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:08.818781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07df258-13f5-42e8-9e6c-cc00a575788f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.835535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.838776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.840833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.843820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.845022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:08.847746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:08.860559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e22d5-474f-460e-b7ed-03b9f6fa82b2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:08.868054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:08.870444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:08.871121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:08.872435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:08.876759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:08.895594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 894/1788] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:08 2021] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:08.897246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.000864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.002484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.015975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 895/1789] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:08 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:09.016771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.030266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6df2ac-9223-4f2e-9b0f-bd7d6f2801b5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.032952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152aa12b-8e80-4c07-b572-7e89a8b17755 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.038423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.039310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.039682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.039796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.040151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.040393 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.040961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.041257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.041846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.041995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.044062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.044443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.063999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 895/1790] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:09.070717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.091205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c826e-5342-4b3b-acc3-b3933add0076 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.100385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 896/1791] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:09 2021] POST /identity/v3/users => generated 291 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:09.102386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.109923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.110924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.111220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.111495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] PATH_INFO: `/v3/projects/f43357f7100243a284b5c0dc966ab872/users/d001b3a1ce2d4922847d3ea62bc2312d/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.127927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e49a2b-a00f-4065-90b5-d495a21fc78b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.139186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.141256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.141893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.142553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.160325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.169012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.179691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43357f7100243a284b5c0dc966ab872, user_id=d001b3a1ce2d4922847d3ea62bc2312d, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.191177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.197854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 897/1792] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:09 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:09.199665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.235813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2693-cd16-468c-984d-4fb2d797eecb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.250553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 896/1793] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:09 2021] PUT /identity/v3/projects/f43357f7100243a284b5c0dc966ab872/users/d001b3a1ce2d4922847d3ea62bc2312d/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:09.254654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.392223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.393524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.394253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.394934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.395890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.398247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.413450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 898/1794] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:09 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:09.418849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be234-2c85-4430-a8e1-7fc427a395dc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.421342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.430137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.431753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.432308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.432943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.435080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.437774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1fca-76ee-4b2f-86d7-1029e05abbc0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.439579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.448844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ee31-cafb-4949-baff-21db7d2dce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.451103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ee31-cafb-4949-baff-21db7d2dce09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.455598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ee31-cafb-4949-baff-21db7d2dce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.455983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ee31-cafb-4949-baff-21db7d2dce09 admin admin] PATH_INFO: `/v3/projects/0b8cc0ac54f746b9bb8b522a31987f25/users/68dff1899b1e429a8c0d6b351fdf5353/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.463549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 897/1795] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:09 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:09.468153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.482139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ee31-cafb-4949-baff-21db7d2dce09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8cc0ac54f746b9bb8b522a31987f25, user_id=68dff1899b1e429a8c0d6b351fdf5353, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.486669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ee31-cafb-4949-baff-21db7d2dce09 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.488117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9c2ff-a249-4e4b-be11-9797efb6bbca admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.500930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915be204-e847-4709-8720-a856acb4e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.504421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be204-e847-4709-8720-a856acb4e0ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.505600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be204-e847-4709-8720-a856acb4e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.506227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be204-e847-4709-8720-a856acb4e0ba admin admin] PATH_INFO: `/v3/projects/f43357f7100243a284b5c0dc966ab872/users/d001b3a1ce2d4922847d3ea62bc2312d/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.516722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 899/1796] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:09 2021] PUT /identity/v3/projects/0b8cc0ac54f746b9bb8b522a31987f25/users/68dff1899b1e429a8c0d6b351fdf5353/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:09.522791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915be204-e847-4709-8720-a856acb4e0ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43357f7100243a284b5c0dc966ab872, user_id=d001b3a1ce2d4922847d3ea62bc2312d, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.528386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915be204-e847-4709-8720-a856acb4e0ba admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.545182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b76145-0e7e-48fa-82bb-b14ca8627d05 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.545779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b76145-0e7e-48fa-82bb-b14ca8627d05 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.546133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b76145-0e7e-48fa-82bb-b14ca8627d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.565933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 898/1797] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:09 2021] PUT /identity/v3/projects/f43357f7100243a284b5c0dc966ab872/users/d001b3a1ce2d4922847d3ea62bc2312d/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:09.593829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-61b76145-0e7e-48fa-82bb-b14ca8627d05 None None] MFA Rules not processed for user `68dff1899b1e429a8c0d6b351fdf5353`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:09.595142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61b76145-0e7e-48fa-82bb-b14ca8627d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:09.609853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0529c-e345-4170-a86a-28f9836d99cf None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.611344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0529c-e345-4170-a86a-28f9836d99cf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.611703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0529c-e345-4170-a86a-28f9836d99cf None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.613924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 899/1798] 10.222.0.60 () {54 vars in 912 bytes} [Wed Nov 10 15:55:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:55:09.621201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.621201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.621679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.653165 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] MFA Rules not processed for user `2ecc2dca57d045869f1fcf3a4337b990`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:09.654882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:09.709341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 900/1799] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:09.711273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.711687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.712848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.737528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 900/1800] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:55:09 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:09.741622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.760890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] MFA Rules not processed for user `d001b3a1ce2d4922847d3ea62bc2312d`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:09.762183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:09.861769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 901/1801] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:09 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:09.863193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.869980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:09.885397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2805e-690f-4893-8618-b8abc138cbbb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.889916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.890651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.890925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.891251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.903197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.905239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.920707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 902/1802] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:09 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:09.921999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:09.923935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84352c3-a0c0-42c7-be3c-cb3faf223516 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.932248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.934057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.935473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.935807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.936715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.942901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:09.943676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d0f46-95e2-4358-8f9b-6062021fdace service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:09.954535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:09.955492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:09.955710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:09.955982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] PATH_INFO: `/v3/users/43c5e2b806a14d42ae89af7b4acccee9` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:09.962259 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c5e2b806a14d42ae89af7b4acccee9)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:09.967870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:10.002116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 901/1803] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:09 2021] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:10.003565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:10.006350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.071250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c5e2b806a14d42ae89af7b4acccee9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.072037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c5e2b806a14d42ae89af7b4acccee9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.073790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c5e2b806a14d42ae89af7b4acccee9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.091869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c5e2b806a14d42ae89af7b4acccee9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.112960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c5e2b806a14d42ae89af7b4acccee9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.121035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3a87-0d28-4c85-a6c6-d0fa421c7c81 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:10.128613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:10.129516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.129804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.130077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] PATH_INFO: `/v3/projects/1dcaeb49de794c1885b755a4556a5e14` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.131490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 903/1804] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:09 2021] DELETE /identity/v3/users/43c5e2b806a14d42ae89af7b4acccee9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:10.131621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcaeb49de794c1885b755a4556a5e14)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:10.132744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:10.133692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:10.134717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.223684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcaeb49de794c1885b755a4556a5e14', 'request_id': 'req-96377b1b-cb95-456e-af65-8c166c421118'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.248627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcaeb49de794c1885b755a4556a5e14', 'request_id': 'req-96377b1b-cb95-456e-af65-8c166c421118'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.255543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5367f75-7017-470a-a9f1-9abdc240a039 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:10.260430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcaeb49de794c1885b755a4556a5e14', 'request_id': 'req-96377b1b-cb95-456e-af65-8c166c421118'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.290097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] The token cache is being invalidate because project 1dcaeb49de794c1885b755a4556a5e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:10.291820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.293984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.298923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 902/1805] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:10 2021] DELETE /identity/v3/projects/1dcaeb49de794c1885b755a4556a5e14 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:10.299964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:10.306142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.350981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821064-f19a-4954-81b4-08e2770a7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:10.352108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821064-f19a-4954-81b4-08e2770a7597 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.352600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821064-f19a-4954-81b4-08e2770a7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.353042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821064-f19a-4954-81b4-08e2770a7597 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.354250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821064-f19a-4954-81b4-08e2770a7597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:10.357498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821064-f19a-4954-81b4-08e2770a7597 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:10.391084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 904/1806] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:10 2021] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:10.406143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.407778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.408216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.410553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96377b1b-cb95-456e-af65-8c166c421118 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:10.415897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:10.417469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.417760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.418042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] PATH_INFO: `/v3/projects/ba5dfa63496740a49a4f11c36133a7d7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.419467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5dfa63496740a49a4f11c36133a7d7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:10.423262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:10.446994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:10.449483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.464540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 905/1807] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:10.465480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:10.467341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.481669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbfa97-a77c-4cfb-82c5-408dcf6b0d5e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:10.487977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:10.488963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.489487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.489487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] PATH_INFO: `/v3/users/75847170daed44cd9a05ef34e22a7dd3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.490933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75847170daed44cd9a05ef34e22a7dd3)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:10.503918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:10.518919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5dfa63496740a49a4f11c36133a7d7', 'request_id': 'req-afda2cc0-39a3-4f93-8d88-d32700c34ede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.537873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5dfa63496740a49a4f11c36133a7d7', 'request_id': 'req-afda2cc0-39a3-4f93-8d88-d32700c34ede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.551823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5dfa63496740a49a4f11c36133a7d7', 'request_id': 'req-afda2cc0-39a3-4f93-8d88-d32700c34ede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.576179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] The token cache is being invalidate because project ba5dfa63496740a49a4f11c36133a7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:10.579482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.581276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.585524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 903/1808] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:10 2021] DELETE /identity/v3/projects/ba5dfa63496740a49a4f11c36133a7d7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:10.590060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:10.590060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.603401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75847170daed44cd9a05ef34e22a7dd3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.604280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75847170daed44cd9a05ef34e22a7dd3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.605964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75847170daed44cd9a05ef34e22a7dd3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.620336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75847170daed44cd9a05ef34e22a7dd3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.654941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75847170daed44cd9a05ef34e22a7dd3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:10.694372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 906/1809] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:10 2021] DELETE /identity/v3/users/75847170daed44cd9a05ef34e22a7dd3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:10.696584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:10.700377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.767094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda2cc0-39a3-4f93-8d88-d32700c34ede admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:10.887545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ddfe6-c6a9-4a08-9abb-f6d642c12b68 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:10.895869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:10.896985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.898357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.899943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.903947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:10.927418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9024e2-701d-4ea8-b8b5-57b811113648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:10.929930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9024e2-701d-4ea8-b8b5-57b811113648 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.934101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9024e2-701d-4ea8-b8b5-57b811113648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.934541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9024e2-701d-4ea8-b8b5-57b811113648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:10.936766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9024e2-701d-4ea8-b8b5-57b811113648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:10.944096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9024e2-701d-4ea8-b8b5-57b811113648 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:10.972740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 904/1810] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:10 2021] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:10.974877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:10.975364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:10.975661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.001789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:11.001789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:11.024168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 905/1811] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:11.025754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.027573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:11.043217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cfb9e-12f7-473b-a241-830264a94344 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.049749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.050802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.051043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.051304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] PATH_INFO: `/v3/projects/abdb5549df91402e8cd4f8a1dfd60857/users/2b0d91314d044cdebed1c42afdcbc922/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.060177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.072612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76db0b-113b-45b0-9fe4-5ca0cad25b26 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.105264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdb5549df91402e8cd4f8a1dfd60857, user_id=2b0d91314d044cdebed1c42afdcbc922, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.109910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.113116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 907/1812] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:11.115496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.115804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.119754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.152560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 906/1813] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:11 2021] PUT /identity/v3/projects/abdb5549df91402e8cd4f8a1dfd60857/users/2b0d91314d044cdebed1c42afdcbc922/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:11.155396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.186606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:11.188633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:11.302236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 908/1814] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:11.307669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.310920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290939-c399-4100-a3fc-7afcf70df78d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.320524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9feb-46a0-427c-8e5a-02d272ab4304 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.321287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.322562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.322843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.323203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.324216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.325798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.326634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.327075 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.327190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.327398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.328482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:11.328790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.330929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.345824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 907/1815] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:11 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:11.358941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.359239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 909/1816] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:55:11.359239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.370255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704feaf-d349-4a5a-9db2-75d1b923a3ef admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.374822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32580056-9a40-49db-8a4d-fd2059b79714 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.376766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab05669-ae03-492a-85f2-9f972c0e78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.377937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05669-ae03-492a-85f2-9f972c0e78e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.378417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05669-ae03-492a-85f2-9f972c0e78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.378848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05669-ae03-492a-85f2-9f972c0e78e6 admin admin] PATH_INFO: `/v3/projects/abdb5549df91402e8cd4f8a1dfd60857/users/2b0d91314d044cdebed1c42afdcbc922/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.381170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.381955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab05669-ae03-492a-85f2-9f972c0e78e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdb5549df91402e8cd4f8a1dfd60857, user_id=2b0d91314d044cdebed1c42afdcbc922, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.382526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.383430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.383782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.384586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.387707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab05669-ae03-492a-85f2-9f972c0e78e6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.387911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.403381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 908/1817] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:11 2021] PUT /identity/v3/projects/abdb5549df91402e8cd4f8a1dfd60857/users/2b0d91314d044cdebed1c42afdcbc922/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:11.420444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.420906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.421338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.427123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 910/1818] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:11 2021] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:11.431787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.460155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] MFA Rules not processed for user `2b0d91314d044cdebed1c42afdcbc922`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:11.461612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:11.570107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd9f5c-0b1e-427d-86d4-860ea2792593 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.577392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.578333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.579067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.579185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.580508 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.582816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.590581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 909/1819] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:11 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:11.602047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.604429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:11.639991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 911/1820] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:11 2021] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:11.641016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.655113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184085b9-d408-4a06-8ce3-3228b9f6655e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.663514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.664381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.664752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.665093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.666031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.668546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.688950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 912/1821] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:11 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:11.690144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.707969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc84a6-4c33-43ab-ba9b-98fc739cf808 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.715391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.716100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.716512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.717006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.718793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.721005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.737003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 913/1822] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:11 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:11.745086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.752736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54d200-199f-47db-8cf2-64015c53633e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.758503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd650-3aa6-4d81-89c4-61e516aac00a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:11.764064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2224-6692-48ba-b0ec-43d32775fce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.765145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:11.765519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2224-6692-48ba-b0ec-43d32775fce7 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.765996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2224-6692-48ba-b0ec-43d32775fce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.766327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.766659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2224-6692-48ba-b0ec-43d32775fce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.766760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.767713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] PATH_INFO: `/v3/projects/c8612240d2b041f281822c6bbade4b66/users/d2012e1322044cb59faff74dab6c03d7/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.794668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2224-6692-48ba-b0ec-43d32775fce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.797670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2224-6692-48ba-b0ec-43d32775fce7 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.805264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8612240d2b041f281822c6bbade4b66, user_id=d2012e1322044cb59faff74dab6c03d7, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:11.810120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:11.823439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 910/1823] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:11 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:11.847947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 914/1824] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:11 2021] PUT /identity/v3/projects/c8612240d2b041f281822c6bbade4b66/users/d2012e1322044cb59faff74dab6c03d7/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:11.858123 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:11.858757 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:11.859348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:11.915278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] MFA Rules not processed for user `d2012e1322044cb59faff74dab6c03d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:11.916731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:11.946379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:11.947860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:12.100228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c466-6c50-43b4-94c4-93d6c2dfaad4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.106664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.120481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.123499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.125412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] PATH_INFO: `/v3/projects/9b918052fa924fdfb2f20297fb0c3519` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.131118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b918052fa924fdfb2f20297fb0c3519)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.142401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.146244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 911/1825] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:11 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:12.147456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.226254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475651c-ca74-4f8c-bc36-2bea463fc058 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.233093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.234118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.234434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.234770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.239682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:12.305444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b918052fa924fdfb2f20297fb0c3519', 'request_id': 'req-cc17763a-9073-4cd2-8b17-3f154ea7d083'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:12.325294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b918052fa924fdfb2f20297fb0c3519', 'request_id': 'req-cc17763a-9073-4cd2-8b17-3f154ea7d083'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:12.330074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.331754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.332938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b918052fa924fdfb2f20297fb0c3519', 'request_id': 'req-cc17763a-9073-4cd2-8b17-3f154ea7d083'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:12.347703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 912/1826] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:12 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:12.349193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.360199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] The token cache is being invalidate because project 9b918052fa924fdfb2f20297fb0c3519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:12.360556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:12.361956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-cc17763a-9073-4cd2-8b17-3f154ea7d083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:12.367890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 915/1827] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:11 2021] DELETE /identity/v3/projects/9b918052fa924fdfb2f20297fb0c3519 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:12.374845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e6284-0b6e-442e-83df-b78ffa6ac5c0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.375030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e6284-0b6e-442e-83df-b78ffa6ac5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.376107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e6284-0b6e-442e-83df-b78ffa6ac5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.395709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a6ca1-78ae-4b74-8726-b10f60723eb9 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.443804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2f9e6284-0b6e-442e-83df-b78ffa6ac5c0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:12.447381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2f9e6284-0b6e-442e-83df-b78ffa6ac5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:12.531353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.532143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.532320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.532593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.534681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.536719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.575872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 913/1828] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:12 2021] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:12.577277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.579383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:12.662585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41dfe0-b927-49e5-acb9-68d0d1a23a25 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.672814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.676686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.678446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.678893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.681797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.692730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.705337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 916/1829] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:12.708002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.708333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.708644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.746262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 914/1830] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:12 2021] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:12.751815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.754919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:12.756979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:12.782292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 917/1831] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:12.782695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86555de-e2c9-4427-a50f-e3481392e948 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.798438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.799117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.799891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.800181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.800572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.801520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.804222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.828282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe3b7e-a627-4b22-931a-bb4e219892f9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.833296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 915/1832] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:12 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:12.837681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.840739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.842102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.842734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.844709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.846849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:12.848871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.852317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.866988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb5dc3-cef2-46b7-ad68-59f27cf7f979 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.884221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.885017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.885403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.885724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.887449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.890802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.891270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 918/1833] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:12.897941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.924808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 916/1834] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:12 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:12.930479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:12.944531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4c2a-9883-432e-9af4-93db417fd2de admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:12.950491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e08e2-776a-49df-9fc8-65e7945f98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:12.951989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e08e2-776a-49df-9fc8-65e7945f98ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:12.952424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e08e2-776a-49df-9fc8-65e7945f98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:12.952876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e08e2-776a-49df-9fc8-65e7945f98ca admin admin] PATH_INFO: `/v3/projects/5302e9920b6342adba5dbdc939637e22/users/28d3a4b163cb46409337c96e887ec4cc/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:12.974580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e08e2-776a-49df-9fc8-65e7945f98ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5302e9920b6342adba5dbdc939637e22, user_id=28d3a4b163cb46409337c96e887ec4cc, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:12.977676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e08e2-776a-49df-9fc8-65e7945f98ca admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:12.997446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916c20f-3316-4037-86c3-d8ebd731d8bf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:13.011310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 917/1835] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:12 2021] PUT /identity/v3/projects/5302e9920b6342adba5dbdc939637e22/users/28d3a4b163cb46409337c96e887ec4cc/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:13.014468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.014961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.016424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.063255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] MFA Rules not processed for user `28d3a4b163cb46409337c96e887ec4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:13.065340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:13.203702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:13.209389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 918/1836] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:13 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:13.209602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.209602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.209602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.209602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:13.209866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:13.212054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:13.215469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:13.256230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06754-2e47-4f71-abf9-47f6d3542c0d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:13.270830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:13.272576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.274447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.275174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] PATH_INFO: `/v3/projects/69cdeaa36fd3489bbf6aed24739e4817` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.279037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cdeaa36fd3489bbf6aed24739e4817)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:13.284663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:13.309439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 919/1837] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:12 2021] POST /identity/v3/projects => generated 403 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:13.311805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:13.398892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cdeaa36fd3489bbf6aed24739e4817', 'request_id': 'req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.419256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cdeaa36fd3489bbf6aed24739e4817', 'request_id': 'req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.443960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cdeaa36fd3489bbf6aed24739e4817', 'request_id': 'req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.458734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc31dc5-0533-41f0-9c32-97de96ddde3b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:13.464754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] The token cache is being invalidate because project 69cdeaa36fd3489bbf6aed24739e4817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:13.465132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.466487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.482568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 919/1838] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:13 2021] DELETE /identity/v3/projects/69cdeaa36fd3489bbf6aed24739e4817 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:13.482568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:13.491766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:13.574794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:13.577116 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.577440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.577881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.578824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:13.583375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:13.666245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f8d33-e508-4a0c-923f-fc5fff4e35a4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:13.684911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 920/1839] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:13 2021] POST /identity/v3/projects => generated 385 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:13.684911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:13.687747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:13.692857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ebc6-36f3-47eb-a48d-e6c6e3d8a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:13.696627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ebc6-36f3-47eb-a48d-e6c6e3d8a915 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.699809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ebc6-36f3-47eb-a48d-e6c6e3d8a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.703018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ebc6-36f3-47eb-a48d-e6c6e3d8a915 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.703981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ebc6-36f3-47eb-a48d-e6c6e3d8a915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:13.706184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ebc6-36f3-47eb-a48d-e6c6e3d8a915 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:13.774228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 920/1840] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:13 2021] POST /identity/v3/users => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:13.775959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6110740-1b17-4100-8f18-259c77be8263 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.776244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6110740-1b17-4100-8f18-259c77be8263 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.776516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6110740-1b17-4100-8f18-259c77be8263 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.778709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 921/1841] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:55:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:55:13.779592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6110740-1b17-4100-8f18-259c77be8263 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:13.782190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b6110740-1b17-4100-8f18-259c77be8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:13.835713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd9061-1d84-43d9-b0aa-e362202e74c8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:13.843707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:13.847941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.848402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.849038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] PATH_INFO: `/v3/users/d001b3a1ce2d4922847d3ea62bc2312d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.856980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d001b3a1ce2d4922847d3ea62bc2312d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:13.863031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:13.897611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6110740-1b17-4100-8f18-259c77be8263 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:13.915630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:13.916565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:13.916814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:13.917091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:13.919173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:13.926664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:13.976957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 922/1842] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:13 2021] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:13.978001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:13.987274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd001b3a1ce2d4922847d3ea62bc2312d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.988621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd001b3a1ce2d4922847d3ea62bc2312d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:13.989551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd001b3a1ce2d4922847d3ea62bc2312d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:14.002963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c78c90-2736-4ec7-ad79-bdf82f8a29d5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:14.009339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4b602-6e12-4d2e-ad3c-4954cefee642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:14.010055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b602-6e12-4d2e-ad3c-4954cefee642 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.010391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b602-6e12-4d2e-ad3c-4954cefee642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.011113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b602-6e12-4d2e-ad3c-4954cefee642 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.012249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd001b3a1ce2d4922847d3ea62bc2312d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:14.019331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4b602-6e12-4d2e-ad3c-4954cefee642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:14.023149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4b602-6e12-4d2e-ad3c-4954cefee642 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:14.047889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd001b3a1ce2d4922847d3ea62bc2312d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:14.064570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 923/1843] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:13 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:14.074504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.075012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.078936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.115246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 921/1844] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:13 2021] DELETE /identity/v3/users/d001b3a1ce2d4922847d3ea62bc2312d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:14.118763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:14.129831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:14.165318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:14.166599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:14.409719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280ef6b-71e0-416a-a913-f0b9e5a70c03 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:14.421666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:14.422345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.422639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.423602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.424429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:14.426105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:14.432414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 924/1845] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:55:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:14.433439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:14.442014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:14.461022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 922/1846] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:14 2021] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:14.475722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef011-9282-4697-bd44-2bf51f092988 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:14.475859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:14.481256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:14.481958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.482272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.482681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.483536 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:14.485167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:14.503972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138b45-96ae-4752-8466-6a87229dd872 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:14.519312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:14.520315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.520588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.521329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] PATH_INFO: `/v3/projects/b7fe6a53d35e43e6b84dc3ec19251295/users/04956241e957454db43c462381ee8f52/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.543668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 925/1847] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:14 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:14.558869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:14.564597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fe6a53d35e43e6b84dc3ec19251295, user_id=04956241e957454db43c462381ee8f52, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:14.567684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:14.574122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e5774-86c1-4f86-9051-bcb01ea4038b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:14.589045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 923/1848] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:14 2021] PUT /identity/v3/projects/b7fe6a53d35e43e6b84dc3ec19251295/users/04956241e957454db43c462381ee8f52/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:14.592993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:14.612120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1779b-7454-47d4-a3f6-22fd6b19faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:14.620053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1779b-7454-47d4-a3f6-22fd6b19faf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.621398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1779b-7454-47d4-a3f6-22fd6b19faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.621701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1779b-7454-47d4-a3f6-22fd6b19faf0 admin admin] PATH_INFO: `/v3/projects/4e08361ac0014cb3b978e91f0b042901/users/ed143e21a4a24fa9b8d7b0d7ad4c6dea/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.705510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1779b-7454-47d4-a3f6-22fd6b19faf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e08361ac0014cb3b978e91f0b042901, user_id=ed143e21a4a24fa9b8d7b0d7ad4c6dea, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:14.709000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1779b-7454-47d4-a3f6-22fd6b19faf0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:14.751507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 926/1849] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:14 2021] PUT /identity/v3/projects/4e08361ac0014cb3b978e91f0b042901/users/ed143e21a4a24fa9b8d7b0d7ad4c6dea/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:14.757535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fd9b1-476a-4768-adac-5ada6f7e4649 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.758127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fd9b1-476a-4768-adac-5ada6f7e4649 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.758851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fd9b1-476a-4768-adac-5ada6f7e4649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.803071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-759fd9b1-476a-4768-adac-5ada6f7e4649 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:14.815667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-759fd9b1-476a-4768-adac-5ada6f7e4649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:14.845997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166ea7c-0a0a-450c-891f-24d55a112f61 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:14.950593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 927/1850] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:14.955275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801682-75fc-4d87-ab0a-a94a49d33426 None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.955835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801682-75fc-4d87-ab0a-a94a49d33426 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.956374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801682-75fc-4d87-ab0a-a94a49d33426 None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:14.958988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 928/1851] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:55:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:55:14.978866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05df09-cdea-405c-82a9-41609c2517fa None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:14.979612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05df09-cdea-405c-82a9-41609c2517fa None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:14.982086 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05df09-cdea-405c-82a9-41609c2517fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.032692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3e05df09-cdea-405c-82a9-41609c2517fa None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:15.032926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.034728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.035212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.036537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.037858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.040118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.040768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3e05df09-cdea-405c-82a9-41609c2517fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.084921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 924/1852] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:14 2021] GET /identity/v3/roles => generated 1420 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:55:15.089899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.119183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a38471-3b08-43c0-bbe0-16cc231038d3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:15.128201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.130589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.131139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.131602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] PATH_INFO: `/v3/projects/b7fe6a53d35e43e6b84dc3ec19251295/users/04956241e957454db43c462381ee8f52/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.134368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fe6a53d35e43e6b84dc3ec19251295, user_id=04956241e957454db43c462381ee8f52, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.138118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.179422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 925/1853] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:15 2021] PUT /identity/v3/projects/b7fe6a53d35e43e6b84dc3ec19251295/users/04956241e957454db43c462381ee8f52/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:15.183637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.190499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.250805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 929/1854] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:55:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:15.252906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.252906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.252906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.338297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] MFA Rules not processed for user `04956241e957454db43c462381ee8f52`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:15.341900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.361277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a379-f944-41a4-ac48-0c2b4129d09d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:15.367741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.368482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.368776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.369771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.479969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 930/1855] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:15 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:15.485427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.486961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.495444 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.500084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.516616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 926/1856] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:15.517680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.519084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.600851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b2a3-7a2a-441f-bf75-9fbb4b7ccda1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:15.602048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f566723-831a-493e-b12a-157881b089d3 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:15.608267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.609225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.609711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.609831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.610376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.610826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.613323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.613522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.623978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.626045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.628958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.632762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.651444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 931/1857] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:15.652675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.657411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.671453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 927/1858] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:15 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:15.678708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fddf4-5113-44bf-9437-cc343ca7dfe7 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:15.687643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.688925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.689277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.689621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] PATH_INFO: `/v3/projects/f43357f7100243a284b5c0dc966ab872` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.692356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43357f7100243a284b5c0dc966ab872)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.695444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.698752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.700270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.733048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0b78b-a014-43f0-8a7e-06a719c55d9f service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:15.741662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b7b6f-dd1f-4be5-b333-67d0155ffcbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:15.742480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b7b6f-dd1f-4be5-b333-67d0155ffcbb service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.742861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b7b6f-dd1f-4be5-b333-67d0155ffcbb service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.750451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b7b6f-dd1f-4be5-b333-67d0155ffcbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.773187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b7b6f-dd1f-4be5-b333-67d0155ffcbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:15.775871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b7b6f-dd1f-4be5-b333-67d0155ffcbb service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:15.786802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43357f7100243a284b5c0dc966ab872', 'request_id': 'req-afafc9f6-3f71-4b3a-8635-4241be584130'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:15.802685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43357f7100243a284b5c0dc966ab872', 'request_id': 'req-afafc9f6-3f71-4b3a-8635-4241be584130'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:15.808546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 928/1859] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:15.825614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43357f7100243a284b5c0dc966ab872', 'request_id': 'req-afafc9f6-3f71-4b3a-8635-4241be584130'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:15.842108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] The token cache is being invalidate because project f43357f7100243a284b5c0dc966ab872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:15.842519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:15.843462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:15.845648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 932/1860] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:15 2021] DELETE /identity/v3/projects/f43357f7100243a284b5c0dc966ab872 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:15.851720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291096af-ea3d-4eb5-964e-bb32601e865c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:15.852232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291096af-ea3d-4eb5-964e-bb32601e865c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:15.852232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291096af-ea3d-4eb5-964e-bb32601e865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:15.878445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-291096af-ea3d-4eb5-964e-bb32601e865c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:15.880154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-291096af-ea3d-4eb5-964e-bb32601e865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:15.980388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:15.982991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.114912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 929/1861] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:16.116544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.116827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.117107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.160548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:16.161786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.184587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 930/1862] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:16.187047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.208074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752d9dd-2bb5-4e7f-a365-7da97103c534 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.220897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc9f6-3f71-4b3a-8635-4241be584130 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.226067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.226931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.227211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.227487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.228256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:16.228565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.230267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.240080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.241046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.245943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.246256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] PATH_INFO: `/v3/users/68dff1899b1e429a8c0d6b351fdf5353` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.247712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dff1899b1e429a8c0d6b351fdf5353)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.249994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.259918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 931/1863] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:16.269451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.286054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69906da5-631c-4735-836e-0a977778b560 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.298345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.299038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.299316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.299584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.300328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.302343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.351110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dff1899b1e429a8c0d6b351fdf5353'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:16.351788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dff1899b1e429a8c0d6b351fdf5353'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:16.352425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dff1899b1e429a8c0d6b351fdf5353'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:16.365453 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dff1899b1e429a8c0d6b351fdf5353'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:16.383361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 932/1864] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:16 2021] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:16.387318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.389194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.399460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4cb44882-1c9b-43ad-97e4-31a0368bd812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dff1899b1e429a8c0d6b351fdf5353'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:16.426180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 933/1865] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:15 2021] DELETE /identity/v3/users/68dff1899b1e429a8c0d6b351fdf5353 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:16.427763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.428376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.428376 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.452104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:16.453389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.535908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa9d9-58d1-490b-a43a-cfde8e30f7f6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.555003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.555820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.555995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.556251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.556979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.557604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 934/1866] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:16.558966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.608253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 933/1867] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:16 2021] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:16.614050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.618238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.620275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.628929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c155ac-0503-41de-84a0-ebfbdfb1a97a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.651008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.653122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.653464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.655001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.657240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.661762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.713968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 935/1868] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:16 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:16.720680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.747689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2d59-aca2-4dd6-92ff-d7f85dc85307 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.754937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.755812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.757011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.757305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.760665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.763200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.763338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8893-4af4-4c29-aaba-8d982013772f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.768196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.768966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.769312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.769656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.775956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 936/1869] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:16 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:16.780972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.784857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.788100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.789183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.804704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 934/1870] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:16.805732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:16.816996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419adf-d661-46ee-952b-56e48a64634d service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.822453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dcd72-c7c4-4545-92ab-4f321e8333ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.823474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcd72-c7c4-4545-92ab-4f321e8333ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.823864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcd72-c7c4-4545-92ab-4f321e8333ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.824241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dcd72-c7c4-4545-92ab-4f321e8333ea admin admin] PATH_INFO: `/v3/projects/4fd26e683f564ba883079f1e277e47e7/users/1bf03e5aaeb04d038856c4201dca7bca/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.846052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dcd72-c7c4-4545-92ab-4f321e8333ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd26e683f564ba883079f1e277e47e7, user_id=1bf03e5aaeb04d038856c4201dca7bca, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:16.849152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dcd72-c7c4-4545-92ab-4f321e8333ea admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:16.877624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dbd8c-7801-4d0e-8d82-0aea2147042d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:16.885911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 935/1871] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:16 2021] PUT /identity/v3/projects/4fd26e683f564ba883079f1e277e47e7/users/1bf03e5aaeb04d038856c4201dca7bca/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:16.897799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.898520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.898872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.945380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] MFA Rules not processed for user `1bf03e5aaeb04d038856c4201dca7bca`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:16.947657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:16.989656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:16.990482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:16.991404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:16.991776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:16.995037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:17.048940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 936/1872] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:16 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:17.058824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:17.132293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.133871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.148871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde63ecf-4a6f-4394-9db6-247467a2afcc None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:17.154460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 937/1873] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:16 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:17.155159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:17.156120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.156679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.157028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.157886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.160380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.211195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:17.220327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 937/1874] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:17 2021] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:17.228154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce372-c259-4dd3-88cd-b4811f1b7668 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:17.403885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:17.403885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.404467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.404467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.405230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.407468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.457359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 938/1875] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:17 2021] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:17.461392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:17.484564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67173c-a795-483c-b1f5-c95d08de000f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:17.500272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:17.503408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.506058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.506948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.509370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.518728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.558954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 938/1876] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:17 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:17.566067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:17.580448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92899ed6-1114-4ea5-8d06-df7dd61c5427 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:17.594962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:17.597110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.597404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.597686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] PATH_INFO: `/v3/projects/68da5f9913d74493861e00c852f2560d/users/7ffc4e3be29e4556b6646be567bc2198/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.645970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68da5f9913d74493861e00c852f2560d, user_id=7ffc4e3be29e4556b6646be567bc2198, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.661483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.685362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 939/1877] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:17 2021] PUT /identity/v3/projects/68da5f9913d74493861e00c852f2560d/users/7ffc4e3be29e4556b6646be567bc2198/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:17.686901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:17.704225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26152-20ca-49aa-8f09-92f8fcbd1294 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:17.846152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7dd72-000b-4477-9c14-370116201ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:17.847532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7dd72-000b-4477-9c14-370116201ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.847840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7dd72-000b-4477-9c14-370116201ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.848367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7dd72-000b-4477-9c14-370116201ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.849455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7dd72-000b-4477-9c14-370116201ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.851963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7dd72-000b-4477-9c14-370116201ca3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.868683 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 939/1878] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:17 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:17.874436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:17.891167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd52c5-d90a-4682-b48e-f0219b663706 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:17.904621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:17.906839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.907142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.907978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] PATH_INFO: `/v3/projects/68da5f9913d74493861e00c852f2560d/users/7ffc4e3be29e4556b6646be567bc2198/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.911087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=68da5f9913d74493861e00c852f2560d, user_id=7ffc4e3be29e4556b6646be567bc2198, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:17.915808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:17.931558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 940/1879] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:17 2021] PUT /identity/v3/projects/68da5f9913d74493861e00c852f2560d/users/7ffc4e3be29e4556b6646be567bc2198/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:17.944565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:17.945180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:17.945180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:17.988181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] MFA Rules not processed for user `7ffc4e3be29e4556b6646be567bc2198`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:17.990147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:18.088797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 940/1880] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:17 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:18.096656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:18.099148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:18.201762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a0d1-6d34-4219-9503-ffa3f108a4cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:18.205974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ab96-ac8c-47e5-816f-686a6eb2c744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:18.207000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ab96-ac8c-47e5-816f-686a6eb2c744 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:18.212327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ab96-ac8c-47e5-816f-686a6eb2c744 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:18.212327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ab96-ac8c-47e5-816f-686a6eb2c744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:18.229176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ab96-ac8c-47e5-816f-686a6eb2c744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:18.231079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ab96-ac8c-47e5-816f-686a6eb2c744 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:18.250073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 941/1881] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:18 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:18.328432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:18.330971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:18.476400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:18.476772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:18.477131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:18.499774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462936-daf9-4819-9850-4eb51759ed58 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:18.512144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:18.513268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:18.513498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:18.513940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] PATH_INFO: `/v3/projects/0b8cc0ac54f746b9bb8b522a31987f25` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:18.516409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8cc0ac54f746b9bb8b522a31987f25)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:18.518418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:18.574440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] MFA Rules not processed for user `ed143e21a4a24fa9b8d7b0d7ad4c6dea`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:18.575774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:18.670026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8cc0ac54f746b9bb8b522a31987f25', 'request_id': 'req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.683059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8cc0ac54f746b9bb8b522a31987f25', 'request_id': 'req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.694566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8cc0ac54f746b9bb8b522a31987f25', 'request_id': 'req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.701665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 942/1882] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:18 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:18.702997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:18.720614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005b548-b08b-4c2d-bb54-35c75a89b5b7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:18.724478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] The token cache is being invalidate because project 0b8cc0ac54f746b9bb8b522a31987f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:18.724769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.727274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.731381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 941/1883] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:18 2021] DELETE /identity/v3/projects/0b8cc0ac54f746b9bb8b522a31987f25 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:18.732141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:18.740805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:18.806021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:18.807342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:18.807842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:18.808270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] PATH_INFO: `/v3/users/1bf03e5aaeb04d038856c4201dca7bca` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:18.809811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf03e5aaeb04d038856c4201dca7bca)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:18.812171 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:18.907243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf03e5aaeb04d038856c4201dca7bca'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.914889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf03e5aaeb04d038856c4201dca7bca'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.915610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf03e5aaeb04d038856c4201dca7bca'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.927416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf03e5aaeb04d038856c4201dca7bca'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.941406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b78b83-d3bb-4f1c-a9ef-48dd16a3368a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:18.956310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d175b4f-0215-4b6b-9d96-4809f3626b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:18.957564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175b4f-0215-4b6b-9d96-4809f3626b65 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:18.959786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf03e5aaeb04d038856c4201dca7bca'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:18.960809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175b4f-0215-4b6b-9d96-4809f3626b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:18.961178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175b4f-0215-4b6b-9d96-4809f3626b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:18.962020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d175b4f-0215-4b6b-9d96-4809f3626b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:18.968274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d175b4f-0215-4b6b-9d96-4809f3626b65 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.002193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 943/1884] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:18 2021] DELETE /identity/v3/users/1bf03e5aaeb04d038856c4201dca7bca => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:19.006332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.011541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.074991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 942/1885] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:18 2021] POST /identity/v3/projects => generated 403 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:19.076859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.077130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.077404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.125189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:19.132870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.162736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f7f6-1a22-4e3b-a629-e0006d893e5c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.223927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 943/1886] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:19.227228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.231757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.246582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fcba-e003-42bd-ac46-0b31e2804a79 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.252871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.253729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.254276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.254655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.255459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.255834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.257374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.257565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.257834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.258361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] PATH_INFO: `/v3/users/2b0d91314d044cdebed1c42afdcbc922` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.260448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0d91314d044cdebed1c42afdcbc922)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.262605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.281985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 944/1887] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:19 2021] POST /identity/v3/users => generated 308 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:19.283094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.285338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.326327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0d91314d044cdebed1c42afdcbc922'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:19.327982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0d91314d044cdebed1c42afdcbc922'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:19.329254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0d91314d044cdebed1c42afdcbc922'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:19.343098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0d91314d044cdebed1c42afdcbc922'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:19.358466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932a047-6de1-4b73-915a-990e7fbf45fc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.361319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0d91314d044cdebed1c42afdcbc922'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:19.362538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.363417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.363709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.363987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.366687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.380500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 944/1888] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:19 2021] DELETE /identity/v3/users/2b0d91314d044cdebed1c42afdcbc922 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:19.380500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.395285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.404840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.406961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.420891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 945/1889] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:19.522275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70943589-6cec-4d01-8a06-3f115d33dc78 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.529229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.530628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.531503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.531891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.533140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.535596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.551360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 945/1890] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:19 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:19.556399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.574927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9f4ea-71b5-4da4-8c81-88b8e71d1ee2 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.581850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.583210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.583536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.583818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] PATH_INFO: `/v3/projects/77caba8dcb314d45bd932a2e19a469ab/users/62cbd9bac55c4353b925d8892bd5ac29/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.604404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77caba8dcb314d45bd932a2e19a469ab, user_id=62cbd9bac55c4353b925d8892bd5ac29, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.607879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.642204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 946/1891] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:19 2021] PUT /identity/v3/projects/77caba8dcb314d45bd932a2e19a469ab/users/62cbd9bac55c4353b925d8892bd5ac29/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:19.646239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.665898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec331a46-54c9-479a-9444-65d4d74a93eb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.802747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.803561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.804100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.804479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.805349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.807126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.824784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 946/1892] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:19 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:19.825692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.840504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287d89-4eea-4756-9e2e-b3da54b00638 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.862662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:19.863610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:19.863958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:19.864221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] PATH_INFO: `/v3/projects/77caba8dcb314d45bd932a2e19a469ab/users/62cbd9bac55c4353b925d8892bd5ac29/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:19.870071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77caba8dcb314d45bd932a2e19a469ab, user_id=62cbd9bac55c4353b925d8892bd5ac29, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:19.873414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:19.887791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.890800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:19.913019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 947/1893] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:19 2021] PUT /identity/v3/projects/77caba8dcb314d45bd932a2e19a469ab/users/62cbd9bac55c4353b925d8892bd5ac29/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:19.924303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865f176-41ce-4044-8d00-025ecc12a121 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:19.933230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:19.935180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:20.026360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:20.027258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.027539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.027830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] PATH_INFO: `/v3/projects/4fd26e683f564ba883079f1e277e47e7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.029138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd26e683f564ba883079f1e277e47e7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:20.031365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:20.111966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2e1a-ecac-4dad-bfd1-7fccaa179db3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:20.147891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd26e683f564ba883079f1e277e47e7', 'request_id': 'req-6da385d7-6731-4cb5-b21b-1b7fe42b9388'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.180662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:20.181632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.181943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.182303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] PATH_INFO: `/v3/projects/abdb5549df91402e8cd4f8a1dfd60857` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.183873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdb5549df91402e8cd4f8a1dfd60857)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:20.186440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:20.189516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd26e683f564ba883079f1e277e47e7', 'request_id': 'req-6da385d7-6731-4cb5-b21b-1b7fe42b9388'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.199795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd26e683f564ba883079f1e277e47e7', 'request_id': 'req-6da385d7-6731-4cb5-b21b-1b7fe42b9388'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.240777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] The token cache is being invalidate because project 4fd26e683f564ba883079f1e277e47e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:20.240777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.240777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.242364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 947/1894] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:19 2021] DELETE /identity/v3/projects/4fd26e683f564ba883079f1e277e47e7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:20.250983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:20.252925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:20.277741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da385d7-6731-4cb5-b21b-1b7fe42b9388 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:20.298335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:20.299270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.299542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.299809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] PATH_INFO: `/v3/users/7ffc4e3be29e4556b6646be567bc2198` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.307478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffc4e3be29e4556b6646be567bc2198)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:20.309507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:20.333263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdb5549df91402e8cd4f8a1dfd60857', 'request_id': 'req-f4e09360-ac03-41ac-aac6-a5698903fb22'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.348668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdb5549df91402e8cd4f8a1dfd60857', 'request_id': 'req-f4e09360-ac03-41ac-aac6-a5698903fb22'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.363303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdb5549df91402e8cd4f8a1dfd60857', 'request_id': 'req-f4e09360-ac03-41ac-aac6-a5698903fb22'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.379564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] The token cache is being invalidate because project abdb5549df91402e8cd4f8a1dfd60857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:20.379880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.382304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f4e09360-ac03-41ac-aac6-a5698903fb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.387762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 948/1895] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:19 2021] DELETE /identity/v3/projects/abdb5549df91402e8cd4f8a1dfd60857 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:20.397239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.397524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.397939 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.415749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffc4e3be29e4556b6646be567bc2198'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.416766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffc4e3be29e4556b6646be567bc2198'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.418388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffc4e3be29e4556b6646be567bc2198'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.426200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:20.427841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:20.436529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffc4e3be29e4556b6646be567bc2198'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.458836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9ca8ef85-0ffe-4dd9-a9f7-479dd86ce938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffc4e3be29e4556b6646be567bc2198'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:20.481790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 948/1896] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:20 2021] DELETE /identity/v3/users/7ffc4e3be29e4556b6646be567bc2198 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:20.571290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 949/1897] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:20.583551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.583840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.584148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.612949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:20.614474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:20.788327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 949/1898] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:20.794054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:20.818196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292542-4fbe-4937-82ed-b58bd02b5e0d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:20.823555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:20.824250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.824486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.824781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.826944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:20.827283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:20.829046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:20.845382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 950/1899] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:20.850255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:20.871480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ecf7-98f1-442c-8e28-f104e01092be None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:20.889397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:20.890751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:20.891056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:20.891351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:20.892129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:20.894637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:20.938098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 950/1900] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:20 2021] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:20.946822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:20.976287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df28ea9-543a-416e-abcb-02f2daecceb8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:21.122556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:21.123917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.123917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.124167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.124830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:21.127295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:21.161220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:21.172100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 951/1901] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:20 2021] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:21.175320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea2b9d-da43-4731-93bf-b626a295417f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:21.185285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:21.186631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.186631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.187269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.188008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:21.190425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:21.205926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 951/1902] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:21 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:21.210533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:21.226388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b9328-87ed-4136-86fd-9625c6791fcc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:21.248089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:21.249868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.250779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.250779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.252537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:21.255719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:21.312364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 952/1903] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:21 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:21.317498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:21.338676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f4024-13fa-4c8e-bea1-d88c963a11f7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:21.351987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755d4a2-02df-4bf7-866b-1c25eb0f749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:21.352949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755d4a2-02df-4bf7-866b-1c25eb0f749b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.358936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755d4a2-02df-4bf7-866b-1c25eb0f749b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.359351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755d4a2-02df-4bf7-866b-1c25eb0f749b admin admin] PATH_INFO: `/v3/projects/b13f55af44f04b5ca05ecc8d6e7565e8/users/13d683bb59a040a2b02af82ce4789f1f/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.390566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:21.395084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:21.408110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755d4a2-02df-4bf7-866b-1c25eb0f749b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13f55af44f04b5ca05ecc8d6e7565e8, user_id=13d683bb59a040a2b02af82ce4789f1f, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:21.426468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755d4a2-02df-4bf7-866b-1c25eb0f749b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:21.450951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 952/1904] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:21 2021] PUT /identity/v3/projects/b13f55af44f04b5ca05ecc8d6e7565e8/users/13d683bb59a040a2b02af82ce4789f1f/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:21.459042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.459440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.460674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.465648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c571ee-912d-4661-a7f9-c02d192fd3e9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:21.532833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] MFA Rules not processed for user `13d683bb59a040a2b02af82ce4789f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:21.536139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:21.562884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:21.563997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.564299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.564584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] PATH_INFO: `/v3/projects/68da5f9913d74493861e00c852f2560d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.566624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68da5f9913d74493861e00c852f2560d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:21.569195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:21.661125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68da5f9913d74493861e00c852f2560d', 'request_id': 'req-d6f188bb-f54c-4441-8200-1c78081ba743'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:21.678867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68da5f9913d74493861e00c852f2560d', 'request_id': 'req-d6f188bb-f54c-4441-8200-1c78081ba743'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:21.689959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68da5f9913d74493861e00c852f2560d', 'request_id': 'req-d6f188bb-f54c-4441-8200-1c78081ba743'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:21.717858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] The token cache is being invalidate because project 68da5f9913d74493861e00c852f2560d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:21.718370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:21.737308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 953/1905] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:21 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:21.745245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d6f188bb-f54c-4441-8200-1c78081ba743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:21.746861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:21.754053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 953/1906] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:21 2021] DELETE /identity/v3/projects/68da5f9913d74493861e00c852f2560d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:21.763004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126279d-cb6c-4eaf-99ed-5455138d2178 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.763306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126279d-cb6c-4eaf-99ed-5455138d2178 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.763681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126279d-cb6c-4eaf-99ed-5455138d2178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.790668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71517d-3250-4f26-8720-1a3e66d3d9fe None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:21.830642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3126279d-cb6c-4eaf-99ed-5455138d2178 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:21.832720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3126279d-cb6c-4eaf-99ed-5455138d2178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:21.942817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:21.944132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.944769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.945314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 954/1907] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:21.946486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:21.947434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:21.951620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:21.964024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:21.964159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:21.964446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.004614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:22.007735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:22.045310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 954/1908] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:21 2021] POST /identity/v3/projects => generated 365 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:22.055338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 955/1909] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:22.060247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.062828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.073002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c6202-3f39-4d02-9d3d-61f8c3b2147f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.073187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:22.191279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.191995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.192291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.192568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.193831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:22.195167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.196993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1c154-3ace-444a-8472-e7b1458c9654 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.211976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 956/1910] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:22.213459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.213761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.214040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.230683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10db3-4890-49aa-bbd4-ebedff00efc5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.239277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.240828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.241312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.241468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.245026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.245026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.274724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] MFA Rules not processed for user `62cbd9bac55c4353b925d8892bd5ac29`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:22.274724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:22.289888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 955/1911] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:22 2021] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:22.291422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.303470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d87ca-c9d6-48d9-9a33-1d5d5602ae56 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.310403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.311547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.311929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.312275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.313111 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.315251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.349218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 956/1912] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:22 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:22.350597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.352532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:22.404819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 957/1913] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:22 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:22.404819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.417584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0e34-8228-4567-a8b3-03a5d460b607 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.470269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2d63f-5d8f-4d1d-9abf-960d1c898cd9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.482257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.483918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.484393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.485043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.487782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:22.508218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.511152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.511570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.512014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.513059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.519354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.539300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 958/1914] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:22.540296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.561765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866d212-3855-4dc5-8cf2-381f097d9cd9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.578844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.581237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.582534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.583371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.584921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.589592 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.617243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.619118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.649857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 957/1915] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:22 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:22.652546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.659745 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 959/1916] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:22 2021] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:22.666467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.674793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26aa4-8901-47a5-a4d3-03c8b83298b2 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.682741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.684663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.685302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.685949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] PATH_INFO: `/v3/projects/affdc397b0a74f419f5264ada0a08734/users/bad00a1b2e31488d908b5d3974a54b60/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.717337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=affdc397b0a74f419f5264ada0a08734, user_id=bad00a1b2e31488d908b5d3974a54b60, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.718747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b67e-0d3b-4f36-8ac8-2388f904dbd3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:22.736420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.743536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:22.744999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:22.745775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:22.746372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:22.754421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:22.757368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:22.774632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 958/1917] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:22 2021] PUT /identity/v3/projects/affdc397b0a74f419f5264ada0a08734/users/bad00a1b2e31488d908b5d3974a54b60/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:22.779732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.815505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 960/1918] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:22.816799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:22.848160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4293-ccf3-4bcf-9e71-511b1bfde367 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:23.003971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065f20-1899-40ce-956d-a55e0c37f4cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:23.024087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:23.025472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.028950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.029918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.039477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:23.051964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:23.070440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:23.074985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.075579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.076104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.077593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:23.086682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:23.089618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 959/1919] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:55:23.101862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:23.123384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7b754-ce53-4b9d-92d8-5ac8b45a29c8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:23.142710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a3dd-3511-403e-8736-7ae103ddcbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:23.143836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a3dd-3511-403e-8736-7ae103ddcbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.143977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 961/1920] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:23.147857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a3dd-3511-403e-8736-7ae103ddcbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.148567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a3dd-3511-403e-8736-7ae103ddcbbb admin admin] PATH_INFO: `/v3/projects/affdc397b0a74f419f5264ada0a08734/users/bad00a1b2e31488d908b5d3974a54b60/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.153656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:23.157986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a3dd-3511-403e-8736-7ae103ddcbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=affdc397b0a74f419f5264ada0a08734, user_id=bad00a1b2e31488d908b5d3974a54b60, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:23.165706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a3dd-3511-403e-8736-7ae103ddcbbb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:23.172184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac3c8-a772-4cf3-b2a0-d34508938f43 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:23.187175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbc6db-15c8-487f-90ba-d4eee5fbd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:23.188094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbc6db-15c8-487f-90ba-d4eee5fbd3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.188396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbc6db-15c8-487f-90ba-d4eee5fbd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.188670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbc6db-15c8-487f-90ba-d4eee5fbd3ec admin admin] PATH_INFO: `/v3/projects/fea109d3cdc240549e87586203e32694/users/062fb05173874ee2aafdac914181955f/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.208551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 960/1921] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:23 2021] PUT /identity/v3/projects/affdc397b0a74f419f5264ada0a08734/users/bad00a1b2e31488d908b5d3974a54b60/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:23.210937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.211770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.212121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.236411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbc6db-15c8-487f-90ba-d4eee5fbd3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea109d3cdc240549e87586203e32694, user_id=062fb05173874ee2aafdac914181955f, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:23.240117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbc6db-15c8-487f-90ba-d4eee5fbd3ec admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:23.260626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] MFA Rules not processed for user `bad00a1b2e31488d908b5d3974a54b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:23.262307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:23.287380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 962/1922] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:23 2021] PUT /identity/v3/projects/fea109d3cdc240549e87586203e32694/users/062fb05173874ee2aafdac914181955f/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:23.299179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.299469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.299748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.387121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] MFA Rules not processed for user `062fb05173874ee2aafdac914181955f`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:23.389093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:23.459182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 961/1923] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:23 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:23.517536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 963/1924] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:23 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:23.521852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:23.612528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:23.615221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aec18-8a3c-4a77-9dee-e33c5e1ba908 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:23.615746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:23.770568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:23.771687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.772203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.772649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.773710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:23.775689 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:23.810133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123d97-1f54-4bd5-a2ee-0d813d49e66e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:23.821159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:23.822596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:23.823014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:23.823415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:23.855866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 962/1925] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:23 2021] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:23.861350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:23.943520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:23.946596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:23.978942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 964/1926] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:23 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:24.059542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f14e5d-123d-4fd9-a48c-a55061ff6ab9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:24.078434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:24.078723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.079010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.079446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.080031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:24.082052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:24.134255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 963/1927] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:23 2021] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:24.141623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:24.183857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed153a-8b18-4343-b01e-9da1e4827581 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:24.209794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:24.223421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.223721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.224043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.224886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:24.231468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:24.273516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 965/1928] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:24 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:24.280559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:24.291756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:24.304033 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39058ac2-3a90-4767-ae05-ac3824431597 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:24.316919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:24.318034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.318450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.318833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] PATH_INFO: `/v3/projects/68426a811d2743fd826fbdcf46bd5b13/users/26069b5d5da5449f8f6534780111ec38/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.369742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68426a811d2743fd826fbdcf46bd5b13, user_id=26069b5d5da5449f8f6534780111ec38, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:24.382867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:24.416624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 964/1929] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:24 2021] PUT /identity/v3/projects/68426a811d2743fd826fbdcf46bd5b13/users/26069b5d5da5449f8f6534780111ec38/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:24.421288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:24.440437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6602f4-db16-4d65-bdc3-e566c59c7b54 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:24.527428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e18a12-2fe6-45e1-97c8-bd07329af6a6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:24.537980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:24.539360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.539924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.540393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.542127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:24.543009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:24.543821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.544108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.544385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.545387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:24.546955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:24.571411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 965/1930] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:24 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:55:24.575378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:24.612332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1dd8-0d8e-4d97-a6d8-3d626cc90ef5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:24.625707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122a91-c2f0-410a-9ca8-6df078942add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:24.625707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122a91-c2f0-410a-9ca8-6df078942add admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.626618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122a91-c2f0-410a-9ca8-6df078942add admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.627278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122a91-c2f0-410a-9ca8-6df078942add admin admin] PATH_INFO: `/v3/projects/68426a811d2743fd826fbdcf46bd5b13/users/26069b5d5da5449f8f6534780111ec38/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.631265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122a91-c2f0-410a-9ca8-6df078942add admin admin] RBAC: Authorizing `identity:create_grant(project_id=68426a811d2743fd826fbdcf46bd5b13, user_id=26069b5d5da5449f8f6534780111ec38, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:24.637464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122a91-c2f0-410a-9ca8-6df078942add admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:24.657011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 966/1931] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:24 2021] PUT /identity/v3/projects/68426a811d2743fd826fbdcf46bd5b13/users/26069b5d5da5449f8f6534780111ec38/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:24.657535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:24.659919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:24.668736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:24.669121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:24.669274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:24.689032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 966/1932] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:24 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:24.709350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] MFA Rules not processed for user `26069b5d5da5449f8f6534780111ec38`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:24.709350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:24.787128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 967/1933] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:24 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:24.981167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:25.006376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab758a1-9a20-46fb-a624-a42b16c6dddf service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:25.163131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:25.164250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:25.164879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:25.165164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:25.177243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:25.178886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:25.201334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 967/1934] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:24 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:25.297198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:25.300288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:25.388352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:25.400402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ac92-fc09-438b-999f-a94c9810dea2 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:25.409653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:25.414492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:25.415118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:25.415561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:25.487493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646df3-e8a6-4642-afe4-fe411851dc09 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:25.504701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:25.506443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:25.506950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:25.507454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] PATH_INFO: `/v3/users/ed143e21a4a24fa9b8d7b0d7ad4c6dea` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:25.511040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed143e21a4a24fa9b8d7b0d7ad4c6dea)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:25.515107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:25.518331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:25.520090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:25.530412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 968/1935] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:25 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:25.594606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed143e21a4a24fa9b8d7b0d7ad4c6dea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:25.595444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed143e21a4a24fa9b8d7b0d7ad4c6dea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:25.596081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed143e21a4a24fa9b8d7b0d7ad4c6dea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:25.615517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed143e21a4a24fa9b8d7b0d7ad4c6dea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:25.632729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed143e21a4a24fa9b8d7b0d7ad4c6dea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:25.651983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 968/1936] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:25 2021] DELETE /identity/v3/users/ed143e21a4a24fa9b8d7b0d7ad4c6dea => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:25.916275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:25.932549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e532fcb-6db6-42e4-8e93-86133e6df1db service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:26.044181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:26.045192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:26.045479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:26.045756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] PATH_INFO: `/v3/projects/4e08361ac0014cb3b978e91f0b042901` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:26.047155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e08361ac0014cb3b978e91f0b042901)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:26.049108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:26.127734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e08361ac0014cb3b978e91f0b042901', 'request_id': 'req-1504e293-9969-4273-912c-f294850bc66b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.143180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e08361ac0014cb3b978e91f0b042901', 'request_id': 'req-1504e293-9969-4273-912c-f294850bc66b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.149878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e08361ac0014cb3b978e91f0b042901', 'request_id': 'req-1504e293-9969-4273-912c-f294850bc66b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.165164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] The token cache is being invalidate because project 4e08361ac0014cb3b978e91f0b042901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:26.165763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.166867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.169216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 969/1937] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:25 2021] DELETE /identity/v3/projects/4e08361ac0014cb3b978e91f0b042901 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:26.173989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:26.176297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:26.197113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890aea96-f715-4026-8a2f-9c71c3d61280 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:26.277281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:26.278279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:26.278558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:26.278875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] PATH_INFO: `/v3/users/62cbd9bac55c4353b925d8892bd5ac29` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:26.280289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cbd9bac55c4353b925d8892bd5ac29)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:26.282369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:26.348384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cbd9bac55c4353b925d8892bd5ac29'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.349045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cbd9bac55c4353b925d8892bd5ac29'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.349699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cbd9bac55c4353b925d8892bd5ac29'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.360837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cbd9bac55c4353b925d8892bd5ac29'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.374228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2b9617e2-0393-446d-af3c-d66dbaee6ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cbd9bac55c4353b925d8892bd5ac29'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.386684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 969/1938] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:26 2021] DELETE /identity/v3/users/62cbd9bac55c4353b925d8892bd5ac29 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:26.774279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:26.776181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:26.790730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e293-9969-4273-912c-f294850bc66b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:26.873464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:26.874510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:26.874663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:26.874931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] PATH_INFO: `/v3/projects/77caba8dcb314d45bd932a2e19a469ab` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:26.877073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77caba8dcb314d45bd932a2e19a469ab)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:26.879497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:26.943847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77caba8dcb314d45bd932a2e19a469ab', 'request_id': 'req-ec40b6a6-c671-4f64-b843-34f1535b5666'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.954381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77caba8dcb314d45bd932a2e19a469ab', 'request_id': 'req-ec40b6a6-c671-4f64-b843-34f1535b5666'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.961374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77caba8dcb314d45bd932a2e19a469ab', 'request_id': 'req-ec40b6a6-c671-4f64-b843-34f1535b5666'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.974188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] The token cache is being invalidate because project 77caba8dcb314d45bd932a2e19a469ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:26.974567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.975362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ec40b6a6-c671-4f64-b843-34f1535b5666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:26.978216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 970/1939] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:26 2021] DELETE /identity/v3/projects/77caba8dcb314d45bd932a2e19a469ab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:26.983213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:26.983720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:26.984158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.007928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:27.009521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.084015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 970/1940] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:27.095036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.096809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.096809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.122073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:27.123779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.132589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 971/1941] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:27.137624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.149707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c6896-e420-4389-a5aa-4473b2800b71 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.155032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.155690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.156039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.156374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.157412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:27.157777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.159982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.175507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 971/1942] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:27.180621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.185504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.187523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.192626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fd9ae-dcc0-4b68-bbaf-81139d90bbae None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.198435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.199433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.200126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.201053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.201797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dc498-9056-447d-b896-04f5eac2d4b0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.202130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.204328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.208541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.209709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.209995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.210377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] PATH_INFO: `/v3/users/d2012e1322044cb59faff74dab6c03d7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.212266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2012e1322044cb59faff74dab6c03d7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.214552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.244061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 972/1943] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:27 2021] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:27.249158 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.313657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2012e1322044cb59faff74dab6c03d7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.314818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2012e1322044cb59faff74dab6c03d7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.315863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2012e1322044cb59faff74dab6c03d7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.335051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2012e1322044cb59faff74dab6c03d7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.338479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5b83-9d9c-49e1-94b5-03b1c8f9ee6b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.343807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a4de9-d979-416d-a982-8248b09d1ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.344493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a4de9-d979-416d-a982-8248b09d1ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.344865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a4de9-d979-416d-a982-8248b09d1ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.345473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a4de9-d979-416d-a982-8248b09d1ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.346680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a4de9-d979-416d-a982-8248b09d1ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.349531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a4de9-d979-416d-a982-8248b09d1ba5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.352973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2012e1322044cb59faff74dab6c03d7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.373375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 972/1944] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:27 2021] DELETE /identity/v3/users/d2012e1322044cb59faff74dab6c03d7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:27.373375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.373375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.387572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 973/1945] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:27 2021] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:27.388252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.388758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.389025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.418738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:27.420384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.456138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713dd7f-3d91-4721-a219-636ad0c02b35 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.462836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.464625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.464910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.465480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] PATH_INFO: `/v3/users/88e846b438d84519982780b1adb42b5f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.467692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e846b438d84519982780b1adb42b5f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.470290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.493848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 974/1946] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:27.494767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.497919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.511142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f982-eae5-4c5a-a716-fb19b634b0e1 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.519390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.520597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.520935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.521277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.522206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.523952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.539627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 975/1947] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:27 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:27.540881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.548128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.569325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e846b438d84519982780b1adb42b5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.570505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e846b438d84519982780b1adb42b5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.572147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e846b438d84519982780b1adb42b5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.591601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e846b438d84519982780b1adb42b5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.606149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e846b438d84519982780b1adb42b5f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:27.623680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 973/1948] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:27 2021] DELETE /identity/v3/users/88e846b438d84519982780b1adb42b5f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:27.623680 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.625030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.649172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16776-e5a2-464e-ad4c-db21d28024bb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.721255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b092-acae-4d04-86b4-79c452844cc8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.725966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.727053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.727373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.727910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.731522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.731817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad421d-59b8-4ee1-871a-d579c386ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.733077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad421d-59b8-4ee1-871a-d579c386ecad admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.733547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad421d-59b8-4ee1-871a-d579c386ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.734001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad421d-59b8-4ee1-871a-d579c386ecad admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.735396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad421d-59b8-4ee1-871a-d579c386ecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.738831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad421d-59b8-4ee1-871a-d579c386ecad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.758708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.759144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 974/1949] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:27 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:27.761559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3f56-5e21-421a-86a0-fa15ecb8c1d8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.762043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3f56-5e21-421a-86a0-fa15ecb8c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.762688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.762997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3f56-5e21-421a-86a0-fa15ecb8c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.786475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 976/1950] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:27.787498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:27.800297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a78c3f56-5e21-421a-86a0-fa15ecb8c1d8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:27.801559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a78c3f56-5e21-421a-86a0-fa15ecb8c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:27.806300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775e8e-ce30-46a2-b1da-a7b20bf62e22 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:27.818057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 975/1951] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:27.822977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:27.823956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.824239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.824516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] PATH_INFO: `/v3/projects/fc7a7938d52d4f2493d8fa1c8e79491a/users/c3cb52275f8a497c84745c58ddb4dede/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.846436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7a7938d52d4f2493d8fa1c8e79491a, user_id=c3cb52275f8a497c84745c58ddb4dede, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:27.849583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:27.874961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 977/1952] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:27 2021] PUT /identity/v3/projects/fc7a7938d52d4f2493d8fa1c8e79491a/users/c3cb52275f8a497c84745c58ddb4dede/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:27.886835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:27.887473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:27.887947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:27.932319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] MFA Rules not processed for user `c3cb52275f8a497c84745c58ddb4dede`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:27.933685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:28.071802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 976/1953] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:27 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:28.072029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.077669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:28.079858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.203399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa2077-c6ee-4fc6-92b8-3efaf8a52b0d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.229692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.229876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.230121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.230680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.235418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3085d-e9a7-450e-8587-f5a07995bf0f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.246909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.248099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.248580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.249575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.250534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.251924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.252191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:28.269960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:28.271280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 978/1954] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:28.324834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 977/1955] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:28 2021] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:28.326114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.344488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7210-93c0-4a34-afd6-902aa90aa410 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.449999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.451681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.452908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.453271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.455532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.457921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:28.488001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 979/1956] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:28 2021] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:28.490009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.504482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbf36d-c9de-449f-bd6e-8839712e8256 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.512686 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.514256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.515075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.515643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.517974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.520600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:28.536940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 978/1957] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:28 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:28.542034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.560677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dbd5b-9972-4082-be03-07c77e02d1c8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.580480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.586484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:28.595614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.602265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.608094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.608927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] PATH_INFO: `/v3/projects/7fe8eb83b3cc48668837b1798a7b1156/users/18a4074d46a4474399b9249c28fa8a0a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.649522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c30861-2fe3-4f6c-aeb3-fa753d7cfc62 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.662423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.664375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.665794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.666652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] PATH_INFO: `/v3/projects/c8612240d2b041f281822c6bbade4b66` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.669401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8612240d2b041f281822c6bbade4b66)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.676157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe8eb83b3cc48668837b1798a7b1156, user_id=18a4074d46a4474399b9249c28fa8a0a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.679426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:28.683435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:28.716333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 980/1958] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:28 2021] PUT /identity/v3/projects/7fe8eb83b3cc48668837b1798a7b1156/users/18a4074d46a4474399b9249c28fa8a0a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:28.720607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.809952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8612240d2b041f281822c6bbade4b66', 'request_id': 'req-567f90f9-f24c-4f3b-8bf1-4718a8f93406'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:28.828374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8612240d2b041f281822c6bbade4b66', 'request_id': 'req-567f90f9-f24c-4f3b-8bf1-4718a8f93406'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:28.840470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8612240d2b041f281822c6bbade4b66', 'request_id': 'req-567f90f9-f24c-4f3b-8bf1-4718a8f93406'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:28.868772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] The token cache is being invalidate because project c8612240d2b041f281822c6bbade4b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:28.869072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:28.873108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:28.876141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 979/1959] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:28 2021] DELETE /identity/v3/projects/c8612240d2b041f281822c6bbade4b66 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:28.876802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9b4b-22d5-4a1f-957e-1e7b3f3471bf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:28.881941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:28.887910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:28.980610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:28.981396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:28.981680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:28.983675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:28.983675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:28.986466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.011690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 981/1960] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:28 2021] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:29.013161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:29.015359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.029384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfbe9-0c23-496f-b99e-748eef0e4acd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:29.035923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f90f9-f24c-4f3b-8bf1-4718a8f93406 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:29.039502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82797a-ca36-429c-b54d-ebc94c05ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:29.040312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82797a-ca36-429c-b54d-ebc94c05ae7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.040742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82797a-ca36-429c-b54d-ebc94c05ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.041162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82797a-ca36-429c-b54d-ebc94c05ae7c admin admin] PATH_INFO: `/v3/projects/7fe8eb83b3cc48668837b1798a7b1156/users/18a4074d46a4474399b9249c28fa8a0a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.042621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:29.043460 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82797a-ca36-429c-b54d-ebc94c05ae7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe8eb83b3cc48668837b1798a7b1156, user_id=18a4074d46a4474399b9249c28fa8a0a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:29.044250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.046339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.047151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] PATH_INFO: `/v3/users/28d3a4b163cb46409337c96e887ec4cc` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.047438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82797a-ca36-429c-b54d-ebc94c05ae7c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.048838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d3a4b163cb46409337c96e887ec4cc)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:29.053035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.067254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 982/1961] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:29 2021] PUT /identity/v3/projects/7fe8eb83b3cc48668837b1798a7b1156/users/18a4074d46a4474399b9249c28fa8a0a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:29.074693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.074693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.074991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.127420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] MFA Rules not processed for user `18a4074d46a4474399b9249c28fa8a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:29.128729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.139354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d3a4b163cb46409337c96e887ec4cc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.140601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d3a4b163cb46409337c96e887ec4cc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.144583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d3a4b163cb46409337c96e887ec4cc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.158606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d3a4b163cb46409337c96e887ec4cc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.185000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d3a4b163cb46409337c96e887ec4cc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.209239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 980/1962] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:28 2021] DELETE /identity/v3/users/28d3a4b163cb46409337c96e887ec4cc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:29.210406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:29.223050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.278630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 983/1963] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:29 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:29.344086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:29.345766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.364585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172806-5f4c-47dd-8398-0881ca0c433a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:29.370015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:29.371913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.372207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.372551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] PATH_INFO: `/v3/projects/030370758a4849bd85a0181896d41bad` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.374491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=030370758a4849bd85a0181896d41bad)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:29.376582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.442359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030370758a4849bd85a0181896d41bad', 'request_id': 'req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.460788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030370758a4849bd85a0181896d41bad', 'request_id': 'req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.472558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030370758a4849bd85a0181896d41bad', 'request_id': 'req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.480441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c58ee3-591b-4ea5-bc8d-0fd69189dec9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:29.490383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] The token cache is being invalidate because project 030370758a4849bd85a0181896d41bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:29.490942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.491402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.493584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 981/1964] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:29 2021] DELETE /identity/v3/projects/030370758a4849bd85a0181896d41bad => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:29.499656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:29.504105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.604762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:29.605720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.606506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.606962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.609425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.619919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d55798-c00b-43a4-a357-0e7fc7b6d6d4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:29.626246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:29.627743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.628262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.628796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] PATH_INFO: `/v3/users/38d7927857f94bc49f24bf1429fdc651` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.630760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d7927857f94bc49f24bf1429fdc651)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:29.633329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.704705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d7927857f94bc49f24bf1429fdc651'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.705773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d7927857f94bc49f24bf1429fdc651'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.706664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d7927857f94bc49f24bf1429fdc651'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.719537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:29.720338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d7927857f94bc49f24bf1429fdc651'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.728321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.736348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0d9b3987-def3-45fd-b724-d4df68cd45fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d7927857f94bc49f24bf1429fdc651'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.750445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 984/1965] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:29 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:29.751814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 982/1966] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:29 2021] DELETE /identity/v3/users/38d7927857f94bc49f24bf1429fdc651 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:29.753450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:29.755825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:29.772124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407faafb-ee64-400d-b370-a56fefa8b2f5 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:29.885536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:29.887287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:29.887716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:29.889486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] PATH_INFO: `/v3/users/062fb05173874ee2aafdac914181955f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:29.891420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062fb05173874ee2aafdac914181955f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:29.894651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:29.964673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062fb05173874ee2aafdac914181955f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.965657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062fb05173874ee2aafdac914181955f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.966459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062fb05173874ee2aafdac914181955f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:29.992711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062fb05173874ee2aafdac914181955f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.018333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062fb05173874ee2aafdac914181955f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.072609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 985/1967] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:29 2021] DELETE /identity/v3/users/062fb05173874ee2aafdac914181955f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:30.079124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.079963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.080665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.131902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:30.133374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.137900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:30.143045 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.311639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 983/1968] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:30.313130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:30.317025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.352068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da3fc-e0fc-49af-a9ca-c436adad7800 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:30.356164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565ccfe-9e61-4602-a83b-fe76b71bf2a7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:30.364323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:30.364461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:30.365413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.365748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.366056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] PATH_INFO: `/v3/projects/5302e9920b6342adba5dbdc939637e22` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.367378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5302e9920b6342adba5dbdc939637e22)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:30.369474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:30.379479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.380002 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.380430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] PATH_INFO: `/v3/projects/27edc238db0f411b954a3dec0421266c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.383577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27edc238db0f411b954a3dec0421266c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:30.387554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:30.454241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5302e9920b6342adba5dbdc939637e22', 'request_id': 'req-9394957b-fcb1-4730-8315-d7dfc5ad9b85'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.466008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5302e9920b6342adba5dbdc939637e22', 'request_id': 'req-9394957b-fcb1-4730-8315-d7dfc5ad9b85'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.480725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5302e9920b6342adba5dbdc939637e22', 'request_id': 'req-9394957b-fcb1-4730-8315-d7dfc5ad9b85'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.503829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] The token cache is being invalidate because project 5302e9920b6342adba5dbdc939637e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:30.504101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.509265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27edc238db0f411b954a3dec0421266c', 'request_id': 'req-a49bd878-03e8-4515-8a19-60d3ca858b7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.510030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.515185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 986/1969] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:30 2021] DELETE /identity/v3/projects/5302e9920b6342adba5dbdc939637e22 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:30.516288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:30.517944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.519403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27edc238db0f411b954a3dec0421266c', 'request_id': 'req-a49bd878-03e8-4515-8a19-60d3ca858b7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.527449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27edc238db0f411b954a3dec0421266c', 'request_id': 'req-a49bd878-03e8-4515-8a19-60d3ca858b7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.543997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] The token cache is being invalidate because project 27edc238db0f411b954a3dec0421266c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:30.543997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.544774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.548567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 984/1970] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:30 2021] DELETE /identity/v3/projects/27edc238db0f411b954a3dec0421266c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:30.549748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:30.551382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.637697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394957b-fcb1-4730-8315-d7dfc5ad9b85 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:30.648665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd878-03e8-4515-8a19-60d3ca858b7e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:30.667224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:30.672771 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.673047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.673331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.675760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.784996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:30.788595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:30.791048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a4074d46a4474399b9249c28fa8a0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe8eb83b3cc48668837b1798a7b1156', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:30.791466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.792061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.793161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.794263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:30.794942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:30.798358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495a491-8be7-40f0-a9ed-df85df56c16d tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:30.814550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 985/1971] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:30.815966 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:30.818424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.840313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1897882-c77b-48fd-800b-3b6b89d96474 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:30.842522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 987/1972] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:30.844710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.845003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.845252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.850654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:30.852307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.852855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.853322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] PATH_INFO: `/v3/users/04956241e957454db43c462381ee8f52` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.855024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04956241e957454db43c462381ee8f52)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:30.858968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:30.892292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:30.894080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.906527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 988/1973] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:30.906527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:30.917361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:30.933383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dda2f-1c96-414e-82a5-aeca93b96b09 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:30.953410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:30.954752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:30.955239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:30.955691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] PATH_INFO: `/v3/users/13d683bb59a040a2b02af82ce4789f1f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:30.958859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d683bb59a040a2b02af82ce4789f1f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:30.960911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:30.975099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04956241e957454db43c462381ee8f52'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.975870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04956241e957454db43c462381ee8f52'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:30.976574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04956241e957454db43c462381ee8f52'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.004786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04956241e957454db43c462381ee8f52'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.034669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04956241e957454db43c462381ee8f52'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.080793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 986/1974] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:30 2021] DELETE /identity/v3/users/04956241e957454db43c462381ee8f52 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:31.084948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.091823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:31.112916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d683bb59a040a2b02af82ce4789f1f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.114563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d683bb59a040a2b02af82ce4789f1f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.115709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d683bb59a040a2b02af82ce4789f1f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.141571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d683bb59a040a2b02af82ce4789f1f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.173883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e5ebf9da-7417-4512-8776-e80a9d708e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d683bb59a040a2b02af82ce4789f1f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.203072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 989/1975] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:30 2021] DELETE /identity/v3/users/13d683bb59a040a2b02af82ce4789f1f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:31.207660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed4a72-c9d7-4c76-afb0-79de1607b9ff None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.207660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed4a72-c9d7-4c76-afb0-79de1607b9ff None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.207660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed4a72-c9d7-4c76-afb0-79de1607b9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.228421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2aed4a72-c9d7-4c76-afb0-79de1607b9ff None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:31.230306 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2aed4a72-c9d7-4c76-afb0-79de1607b9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:31.241007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56793bd-d6ed-408a-b3a9-296b05a3f454 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:31.324369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 990/1976] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:31.332520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.333119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.333914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.365662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:31.367770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:31.387208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 991/1977] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:31.387208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.395679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a4074d46a4474399b9249c28fa8a0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe8eb83b3cc48668837b1798a7b1156', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:31.396837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.397354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.398702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.400032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:31.406509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:31.450876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437390f-6cd2-423f-af60-43043d64a207 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:31.462719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:31.464623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.465124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.465590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.467060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:31.467577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:31.471115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:31.475038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 987/1978] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:31 2021] POST /identity/v3/projects => generated 355 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:31.477473 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.481141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:31.507458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 992/1979] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:31.510318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.515319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:31.544509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b99a9-9f98-42f2-b7d7-716037897534 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:31.626120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22fb6-b7c8-4e22-b46e-a01e432b1e31 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:31.640344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:31.640344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.640872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.641518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.659194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a4074d46a4474399b9249c28fa8a0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe8eb83b3cc48668837b1798a7b1156', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:31.660294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.661041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.670501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.671698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:31.672874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:31.674819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:31.693220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 993/1980] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:31.697155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.815158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:31.816810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:31.832071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 988/1981] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:31.832710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.834415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:31.848066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0edd-6928-4e31-9458-a863a4f8fa0e service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:31.853939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:31.855304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.855663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.856159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] PATH_INFO: `/v3/projects/fea109d3cdc240549e87586203e32694` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.856626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc19a-af34-43da-aee3-fa1eff4bc919 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:31.858675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea109d3cdc240549e87586203e32694)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:31.861998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:31.864789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:31.865956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:31.866223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:31.866825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:31.867957 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:31.870853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:31.930091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 994/1982] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:31 2021] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:31.931797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.949286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea109d3cdc240549e87586203e32694', 'request_id': 'req-5f315cf2-4092-4818-9455-9f425e9c29c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.959942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea109d3cdc240549e87586203e32694', 'request_id': 'req-5f315cf2-4092-4818-9455-9f425e9c29c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.968668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea109d3cdc240549e87586203e32694', 'request_id': 'req-5f315cf2-4092-4818-9455-9f425e9c29c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.980940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] The token cache is being invalidate because project fea109d3cdc240549e87586203e32694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:31.981234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.982409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:31.984194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 989/1983] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:31 2021] DELETE /identity/v3/projects/fea109d3cdc240549e87586203e32694 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:31.985210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:31.988523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.035882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489751d-c8dc-4c8f-babd-c6650b895b41 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.118425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f315cf2-4092-4818-9455-9f425e9c29c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.125104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.126437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.126900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.127366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] PATH_INFO: `/v3/projects/b7fe6a53d35e43e6b84dc3ec19251295` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.128864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fe6a53d35e43e6b84dc3ec19251295)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.131012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.160143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a4074d46a4474399b9249c28fa8a0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe8eb83b3cc48668837b1798a7b1156', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.161361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.161820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.162290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] PATH_INFO: `/v3/projects/b80370909548458094f6b2b1dc7aa829` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.163752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b80370909548458094f6b2b1dc7aa829)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.165884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.238151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80370909548458094f6b2b1dc7aa829', 'request_id': 'req-a12f3dca-a238-4df7-877e-0db25cec35b1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.244729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fe6a53d35e43e6b84dc3ec19251295', 'request_id': 'req-23c35950-3443-413d-b88d-e3e4e07787dd'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.263023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fe6a53d35e43e6b84dc3ec19251295', 'request_id': 'req-23c35950-3443-413d-b88d-e3e4e07787dd'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.273523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fe6a53d35e43e6b84dc3ec19251295', 'request_id': 'req-23c35950-3443-413d-b88d-e3e4e07787dd'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.275790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80370909548458094f6b2b1dc7aa829', 'request_id': 'req-a12f3dca-a238-4df7-877e-0db25cec35b1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.285481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80370909548458094f6b2b1dc7aa829', 'request_id': 'req-a12f3dca-a238-4df7-877e-0db25cec35b1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.295556 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] The token cache is being invalidate because project b7fe6a53d35e43e6b84dc3ec19251295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:32.296052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.297166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.302245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 990/1984] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:31 2021] DELETE /identity/v3/projects/b7fe6a53d35e43e6b84dc3ec19251295 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:32.303802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:32.304096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] The token cache is being invalidate because project b80370909548458094f6b2b1dc7aa829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:32.304607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.306000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.309320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.326630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 995/1985] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:31 2021] DELETE /identity/v3/projects/b80370909548458094f6b2b1dc7aa829 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:32.328504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:32.333237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.402732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35950-3443-413d-b88d-e3e4e07787dd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.424897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.425799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.426105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.426442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.429306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.431435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.462939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 991/1986] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:32 2021] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:32.464008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:32.466227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.480427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c675-8ff4-4af9-a79b-11c5656f931f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.486920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.487911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.488216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.488531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] PATH_INFO: `/v3/projects/b13f55af44f04b5ca05ecc8d6e7565e8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.490033 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13f55af44f04b5ca05ecc8d6e7565e8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.492590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.549151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3dca-a238-4df7-877e-0db25cec35b1 tempest-VolumeQuotaClassesTest-1612510537 tempest-VolumeQuotaClassesTest-1612510537-project-admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.569909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13f55af44f04b5ca05ecc8d6e7565e8', 'request_id': 'req-53582f03-6211-4bb1-b4f1-7727fdbc8463'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.583721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13f55af44f04b5ca05ecc8d6e7565e8', 'request_id': 'req-53582f03-6211-4bb1-b4f1-7727fdbc8463'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.596460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13f55af44f04b5ca05ecc8d6e7565e8', 'request_id': 'req-53582f03-6211-4bb1-b4f1-7727fdbc8463'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.620008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] The token cache is being invalidate because project b13f55af44f04b5ca05ecc8d6e7565e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:32.620298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.621477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-53582f03-6211-4bb1-b4f1-7727fdbc8463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.631651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 992/1987] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:32 2021] DELETE /identity/v3/projects/b13f55af44f04b5ca05ecc8d6e7565e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:32.636863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.637478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.637981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.710696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:32.712879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.727916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.730569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.731083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.734681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] PATH_INFO: `/v3/users/26069b5d5da5449f8f6534780111ec38` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.741302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26069b5d5da5449f8f6534780111ec38)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.745134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.756406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 993/1988] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:32.758864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:32.766225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.806568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a4bd0-c672-4ca0-9430-4cb72f101f2c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.817145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.818378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.818879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.819374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.820805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.824328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.846964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 994/1989] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:32 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:32.848166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:32.849963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:32.865710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24eedf-1933-4650-aaeb-c3491ab58047 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:32.865953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26069b5d5da5449f8f6534780111ec38'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.866657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26069b5d5da5449f8f6534780111ec38'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.867613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26069b5d5da5449f8f6534780111ec38'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.871894 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:32.873259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.874072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.874072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] PATH_INFO: `/v3/users/bad00a1b2e31488d908b5d3974a54b60` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.875549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad00a1b2e31488d908b5d3974a54b60)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:32.877982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:32.881653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26069b5d5da5449f8f6534780111ec38'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.912465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9108ab0e-89df-4c14-a33c-d81e0496f964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26069b5d5da5449f8f6534780111ec38'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.930230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 996/1990] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:32 2021] DELETE /identity/v3/users/26069b5d5da5449f8f6534780111ec38 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:32.930230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:32.930230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:32.930979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:32.976681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad00a1b2e31488d908b5d3974a54b60'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.977496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad00a1b2e31488d908b5d3974a54b60'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.978343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad00a1b2e31488d908b5d3974a54b60'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:32.991162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:32.994265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.000445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad00a1b2e31488d908b5d3974a54b60'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.031667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad00a1b2e31488d908b5d3974a54b60'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.068667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 995/1991] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:32 2021] DELETE /identity/v3/users/bad00a1b2e31488d908b5d3974a54b60 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:33.068667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.081792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.084830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 997/1992] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:33.085724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.087179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.101070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78941-b5f3-42a6-a987-d0399ff0f191 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.171584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.172272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.172555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.172854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.174110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.176111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.189803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 998/1993] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:33.194206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.208971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770448a-9332-4270-bb61-de682e671cfc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.214395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.215003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.217438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.217438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.217438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:33.217438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.218411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.231445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 999/1994] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:33.232461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.243518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf3bd-6f70-44e7-b59c-bf984e781bff admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.249688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.250643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.250837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507f3dd-beb8-48f3-9e45-13efd600f25b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.251030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.251170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] PATH_INFO: `/v3/projects/2ba9200d43e34bc4b10797b82bd91691/users/9ba7966ca6d34642b3dfe891fec080d3/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.257172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.258124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.258453 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.258722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] PATH_INFO: `/v3/users/c3cb52275f8a497c84745c58ddb4dede` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.260148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cb52275f8a497c84745c58ddb4dede)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.262275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.268190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba9200d43e34bc4b10797b82bd91691, user_id=9ba7966ca6d34642b3dfe891fec080d3, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.270931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.295405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1000/1995] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:33 2021] PUT /identity/v3/projects/2ba9200d43e34bc4b10797b82bd91691/users/9ba7966ca6d34642b3dfe891fec080d3/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:33.306640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.408338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cb52275f8a497c84745c58ddb4dede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.410905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cb52275f8a497c84745c58ddb4dede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.414304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cb52275f8a497c84745c58ddb4dede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.430296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bb869-116b-45ab-a9dc-a30cb48a68e3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.436315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cb52275f8a497c84745c58ddb4dede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.442935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.444571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.445771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.446187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.449013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.453748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.466648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-009b650f-3c96-44a9-a1fc-82c9796b49e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cb52275f8a497c84745c58ddb4dede'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.486803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 996/1996] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:33 2021] DELETE /identity/v3/users/c3cb52275f8a497c84745c58ddb4dede => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:33.488403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13ca3-748f-4f6c-ae38-0277c64c419c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.488696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13ca3-748f-4f6c-ae38-0277c64c419c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.489135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13ca3-748f-4f6c-ae38-0277c64c419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.516381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1001/1997] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:33 2021] POST /identity/v3/projects => generated 401 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:33.521471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-43a13ca3-748f-4f6c-ae38-0277c64c419c None None] MFA Rules not processed for user `9ba7966ca6d34642b3dfe891fec080d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:33.521966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.523169 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-43a13ca3-748f-4f6c-ae38-0277c64c419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.523997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.627300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 997/1998] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:33.631234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470e7a-85e9-40a7-acfe-1ae4847568ac admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.633311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.634174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.634600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.636227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.637627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.638061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.638538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] PATH_INFO: `/v3/projects/68426a811d2743fd826fbdcf46bd5b13` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.639948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68426a811d2743fd826fbdcf46bd5b13)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.642130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.658227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:33.662898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.690110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 998/1999] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:33.690110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.690110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.700639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b0cce-e703-49f0-a8ed-c4e868f26259 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.716138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68426a811d2743fd826fbdcf46bd5b13', 'request_id': 'req-f2a86cf2-0156-4af8-af20-df2f43f1db74'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.725198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68426a811d2743fd826fbdcf46bd5b13', 'request_id': 'req-f2a86cf2-0156-4af8-af20-df2f43f1db74'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.732456 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68426a811d2743fd826fbdcf46bd5b13', 'request_id': 'req-f2a86cf2-0156-4af8-af20-df2f43f1db74'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.746869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] The token cache is being invalidate because project 68426a811d2743fd826fbdcf46bd5b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:33.747159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.748366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:33.750192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1002/2000] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:33 2021] DELETE /identity/v3/projects/68426a811d2743fd826fbdcf46bd5b13 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:33.750848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.752192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.778306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.779132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.779416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.779692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.780408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.782411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.805641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 999/2001] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:33 2021] POST /identity/v3/users => generated 301 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:33.806814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.810701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.815601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a86cf2-0156-4af8-af20-df2f43f1db74 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.821297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.822145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.822578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.823090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.825146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.882841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7d9af-1313-4a38-bccd-b217d0a50ae0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.890008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.891120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.891633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.892137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.895322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.911520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.912985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.915619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.917109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be72d6-aa5a-4335-a4aa-3d56dfcaf0b4 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.922606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1003/2002] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:33 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:33.923451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.924918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.928697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1000/2003] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:33.930098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.930443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.930743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.957587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:33.957815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e087ead-9c1b-4d55-8d8e-1525449687c0 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.959019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.963193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.964104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.964379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.964651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] PATH_INFO: `/v3/projects/affdc397b0a74f419f5264ada0a08734` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.966017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=affdc397b0a74f419f5264ada0a08734)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.968456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1001/2004] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:33.969399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:33.969682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:33.971278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:33.985148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3127-a061-4cb9-a6c7-6ed13c034739 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:33.990912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:33.992018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:33.992335 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:33.992609 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:33.993479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:33.995804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.013862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1002/2005] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:34.013862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.015515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.032795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50f32a-865a-4cf3-b1a4-35f7ada271b0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.033155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affdc397b0a74f419f5264ada0a08734', 'request_id': 'req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.043830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affdc397b0a74f419f5264ada0a08734', 'request_id': 'req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.052724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affdc397b0a74f419f5264ada0a08734', 'request_id': 'req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.067861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] The token cache is being invalidate because project affdc397b0a74f419f5264ada0a08734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:34.068200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.068871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f246ea5e-bc3b-4d98-8052-cd70e8ec2a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.070869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1004/2006] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:33 2021] DELETE /identity/v3/projects/affdc397b0a74f419f5264ada0a08734 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:34.072215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.072501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.072826 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.098525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:34.099845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.120362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.123899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.124652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.126577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] PATH_INFO: `/v3/users/9ba7966ca6d34642b3dfe891fec080d3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.131312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba7966ca6d34642b3dfe891fec080d3)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.134613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.194582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1005/2007] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:34.196301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.198604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.203382 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba7966ca6d34642b3dfe891fec080d3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.204577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba7966ca6d34642b3dfe891fec080d3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.205571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba7966ca6d34642b3dfe891fec080d3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.218718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba7966ca6d34642b3dfe891fec080d3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.223495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9e65-ece6-4e09-b27d-c31d9deb9596 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.230148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac322fd-1da4-45ca-87e7-45b7e8e2b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.231166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac322fd-1da4-45ca-87e7-45b7e8e2b85a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.231490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac322fd-1da4-45ca-87e7-45b7e8e2b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.231761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac322fd-1da4-45ca-87e7-45b7e8e2b85a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.233003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac322fd-1da4-45ca-87e7-45b7e8e2b85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.234746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac322fd-1da4-45ca-87e7-45b7e8e2b85a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.246407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba7966ca6d34642b3dfe891fec080d3'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.255839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1006/2008] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:34 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:34.257614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.257998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.258461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.276632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1003/2009] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:34 2021] DELETE /identity/v3/users/9ba7966ca6d34642b3dfe891fec080d3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:34.276632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.276632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.292206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:34.294152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.370993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d3dfd-697f-47dc-a2b7-83fd63bd6267 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.378421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1007/2010] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:34.378648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.378824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.378953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.378953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.378953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.378953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:34.378953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.380490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.380677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805d5f-220f-4140-ae10-93808c36eaf3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.396614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1004/2011] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:34.397644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b190a6-66d3-4088-b4ac-1fd8d8efb97d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.397967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.398287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.398575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.404344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8445787-4f44-4333-856a-7a9c09811646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.405300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8445787-4f44-4333-856a-7a9c09811646 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.405580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8445787-4f44-4333-856a-7a9c09811646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.405857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8445787-4f44-4333-856a-7a9c09811646 admin admin] PATH_INFO: `/v3/projects/f8a3ff37ddd5406a97963047cc03b59c/users/9ed9506743464c3ea545f46c78e3a52a/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.418773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:34.420194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.422294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8445787-4f44-4333-856a-7a9c09811646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a3ff37ddd5406a97963047cc03b59c, user_id=9ed9506743464c3ea545f46c78e3a52a, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.425033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8445787-4f44-4333-856a-7a9c09811646 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.428323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1005/2012] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:34.429254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.430630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.444825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a107f8-64ca-4c36-84d5-86a3bef5ba9b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.447514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1008/2013] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:34 2021] PUT /identity/v3/projects/f8a3ff37ddd5406a97963047cc03b59c/users/9ed9506743464c3ea545f46c78e3a52a/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:34.449685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.450132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.450615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.479049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:34.481056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.527149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.528223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.528606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.529072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] PATH_INFO: `/v3/projects/fc7a7938d52d4f2493d8fa1c8e79491a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.530450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7a7938d52d4f2493d8fa1c8e79491a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.532395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.572904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1009/2014] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:34.573859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.589702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6fb1-5563-475e-a958-c619e2bc8662 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.594705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7a7938d52d4f2493d8fa1c8e79491a', 'request_id': 'req-309d51f0-7ee4-4413-a895-aadddaf7fc78'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.605250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7a7938d52d4f2493d8fa1c8e79491a', 'request_id': 'req-309d51f0-7ee4-4413-a895-aadddaf7fc78'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.612019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7a7938d52d4f2493d8fa1c8e79491a', 'request_id': 'req-309d51f0-7ee4-4413-a895-aadddaf7fc78'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.625364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] The token cache is being invalidate because project fc7a7938d52d4f2493d8fa1c8e79491a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:34.625594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.626459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:34.628088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1006/2015] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:34 2021] DELETE /identity/v3/projects/fc7a7938d52d4f2493d8fa1c8e79491a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:34.628855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.630397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.666581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1a76-d823-4349-89e8-79acb4fb485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.667153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1a76-d823-4349-89e8-79acb4fb485b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.667431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1a76-d823-4349-89e8-79acb4fb485b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.667882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1a76-d823-4349-89e8-79acb4fb485b admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.670373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1a76-d823-4349-89e8-79acb4fb485b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.672385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1a76-d823-4349-89e8-79acb4fb485b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.703024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d51f0-7ee4-4413-a895-aadddaf7fc78 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.708920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1010/2016] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:34.710431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.710720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.710999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.712100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.713031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.713386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.713610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.716105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.739094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.740774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.744091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] MFA Rules not processed for user `9ed9506743464c3ea545f46c78e3a52a`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:34.745949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.752704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1007/2017] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:34.753933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.755630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.768784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc4205-b6da-4067-b209-245898887637 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.859886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1011/2018] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:34.861338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.862218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.863532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.863866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.864373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.865096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.867673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:34.869066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.871939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.881927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824c0e-0877-4c97-9d80-b886b1a291c3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.890401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1008/2019] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:34.891289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.896437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.897475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.897823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.898145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] PATH_INFO: `/v3/users/18a4074d46a4474399b9249c28fa8a0a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.900012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a4074d46a4474399b9249c28fa8a0a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.902369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.902834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.920985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce83ab-ac71-4a3a-80ce-38638cf1087a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.926753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.927746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.928133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.928519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.929381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.931692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:34.958692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1009/2020] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:34.960278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:34.964635 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:34.978995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ab63-ba6a-4128-951e-ad462f408381 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:34.986138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:34.986890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:34.987177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:34.987456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:34.988299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:34.990744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.036937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1010/2021] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:34 2021] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:35.038000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.128816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76933f7-6144-45d0-bc3e-f6aecb3d77be admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.138363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.139346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.139641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.139983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.141023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.142995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.180113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1011/2022] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:35 2021] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:35.180113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.195132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a4074d46a4474399b9249c28fa8a0a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.196196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a4074d46a4474399b9249c28fa8a0a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.197593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a4074d46a4474399b9249c28fa8a0a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.207395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a4074d46a4474399b9249c28fa8a0a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.231096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a4074d46a4474399b9249c28fa8a0a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.256205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1012/2023] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:34 2021] DELETE /identity/v3/users/18a4074d46a4474399b9249c28fa8a0a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:35.259988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.260133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.270471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2cf1-76a9-4a97-94d3-a9c638208567 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.353638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.354624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.355095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.355232 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.355986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.361983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.370796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1012/2024] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:35 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:35.370988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a577-e475-40f4-8c6c-5c62b15e0b18 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.371562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.377106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.387355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.388499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.390570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.390570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.390570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.398067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.405161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6a079-cdd8-4d8c-9edb-4cdde21f7431 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.416010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.418034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.418716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.419195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] PATH_INFO: `/v3/projects/2ba9200d43e34bc4b10797b82bd91691` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.422678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba9200d43e34bc4b10797b82bd91691)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.428417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.435329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1013/2025] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:35 2021] POST /identity/v3/users => generated 306 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:35.436499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.443473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.467750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c4a24-16e8-48b1-8721-e21a0648e41b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.486567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.487763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.488376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.491106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.495600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.503073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.515600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba9200d43e34bc4b10797b82bd91691', 'request_id': 'req-dcdfa9f9-97e1-4049-882f-7483a98dffcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.527577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba9200d43e34bc4b10797b82bd91691', 'request_id': 'req-dcdfa9f9-97e1-4049-882f-7483a98dffcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.536847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba9200d43e34bc4b10797b82bd91691', 'request_id': 'req-dcdfa9f9-97e1-4049-882f-7483a98dffcc'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.548871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1014/2026] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:35 2021] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:35.550637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.552211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.555477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] The token cache is being invalidate because project 2ba9200d43e34bc4b10797b82bd91691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:35.555770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.556433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.558060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1013/2027] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:35 2021] DELETE /identity/v3/projects/2ba9200d43e34bc4b10797b82bd91691 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:35.562503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.562503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.573144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261caa8-1750-4ee2-bf27-ddd724dc12e5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.639925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa9f9-97e1-4049-882f-7483a98dffcc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.645608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.646339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.646621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.646893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.647690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.649413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.660915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1014/2028] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:35 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:35.661810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.668016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.684791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab458-e37f-4e0c-a2bb-971735a3e320 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.693273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.694845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.695306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.695843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.697373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d4735-10d8-48ab-bf07-b63b8d20df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.697531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.698189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d4735-10d8-48ab-bf07-b63b8d20df1f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.698502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d4735-10d8-48ab-bf07-b63b8d20df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.698774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d4735-10d8-48ab-bf07-b63b8d20df1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.699623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d4735-10d8-48ab-bf07-b63b8d20df1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.702231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.702400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d4735-10d8-48ab-bf07-b63b8d20df1f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.724617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1015/2029] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:35 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:35.724617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.724920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1015/2030] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:35 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:35.725347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.725347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.729133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.747128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa58f3-b1ef-4975-bfef-8f1aeed89e13 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.749870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:35.751467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.755561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.757266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.757266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.757266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] PATH_INFO: `/v3/projects/e5d8902c59aa496a95152e6e94c8e7cf/users/89e0f088b9ba49dc96c5cf55e8a3de8b/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.760960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1016/2031] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:35.761571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.763059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.779299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366e42-cc32-4335-b20c-fd31374bf10b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.783441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d8902c59aa496a95152e6e94c8e7cf, user_id=89e0f088b9ba49dc96c5cf55e8a3de8b, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.784942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.785842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.786120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.786436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] PATH_INFO: `/v3/projects/7fe8eb83b3cc48668837b1798a7b1156` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.787411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.787781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe8eb83b3cc48668837b1798a7b1156)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.789580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:35.804938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1016/2032] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:35 2021] PUT /identity/v3/projects/e5d8902c59aa496a95152e6e94c8e7cf/users/89e0f088b9ba49dc96c5cf55e8a3de8b/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:35.805631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.807425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.866431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe8eb83b3cc48668837b1798a7b1156', 'request_id': 'req-ffea2e22-65ec-4b96-84da-c03e80242eda'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.879039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe8eb83b3cc48668837b1798a7b1156', 'request_id': 'req-ffea2e22-65ec-4b96-84da-c03e80242eda'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.881445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2e1b-a170-447a-9c0a-afd43bc2b324 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:35.891755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe8eb83b3cc48668837b1798a7b1156', 'request_id': 'req-ffea2e22-65ec-4b96-84da-c03e80242eda'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.914102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] The token cache is being invalidate because project 7fe8eb83b3cc48668837b1798a7b1156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:35.914703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.915505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:35.917439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1017/2033] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:35 2021] DELETE /identity/v3/projects/7fe8eb83b3cc48668837b1798a7b1156 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:35.925135 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:35.925135 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:35.968932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c597323-d5d0-4a62-b814-fb8309f1636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:35.970192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c597323-d5d0-4a62-b814-fb8309f1636b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:35.970656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c597323-d5d0-4a62-b814-fb8309f1636b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:35.971134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c597323-d5d0-4a62-b814-fb8309f1636b admin admin] PATH_INFO: `/v3/projects/31e44127c6c747bbbe831e3ebc7dc944/users/38fb120cca364f3e8ce51e901206271e/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:35.991710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c597323-d5d0-4a62-b814-fb8309f1636b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e44127c6c747bbbe831e3ebc7dc944, user_id=38fb120cca364f3e8ce51e901206271e, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:35.994822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c597323-d5d0-4a62-b814-fb8309f1636b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.013940 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1017/2034] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:35 2021] PUT /identity/v3/projects/31e44127c6c747bbbe831e3ebc7dc944/users/38fb120cca364f3e8ce51e901206271e/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:36.015934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94beeed-3458-4df5-ad01-7d0be13797c0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.016589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94beeed-3458-4df5-ad01-7d0be13797c0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.017019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94beeed-3458-4df5-ad01-7d0be13797c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.026356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2e22-65ec-4b96-84da-c03e80242eda admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.078671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f94beeed-3458-4df5-ad01-7d0be13797c0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:36.080262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f94beeed-3458-4df5-ad01-7d0be13797c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.154862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.155863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.156287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.156860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.157827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.161440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.181498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1018/2035] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:35 2021] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:36.182961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.185499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.202013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbacb2-a3f3-4c79-b5ad-54f77a0df705 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.208525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9d330-0034-4171-8a86-b2075a97c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.209556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d330-0034-4171-8a86-b2075a97c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.210015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d330-0034-4171-8a86-b2075a97c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.210474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d330-0034-4171-8a86-b2075a97c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.212004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9d330-0034-4171-8a86-b2075a97c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.215196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9d330-0034-4171-8a86-b2075a97c9e7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.236142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1018/2036] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:36.237560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.241355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.242355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.273912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1019/2037] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:36 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:36.273912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.275287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:36.277325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.277928 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.278547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.308656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1019/2038] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:36.311080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.325394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3be36-d341-4428-ae11-0bdaf7029e48 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.331119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] MFA Rules not processed for user `38fb120cca364f3e8ce51e901206271e`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:36.332351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.332868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.334088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.334485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.334875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] PATH_INFO: `/v3/projects/75a2ae36ab5c4513b0e9250ea74b32ff/users/f27ee9d973e54af2a5173bdf89fc34a6/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.357383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a2ae36ab5c4513b0e9250ea74b32ff, user_id=f27ee9d973e54af2a5173bdf89fc34a6, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.361780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.379063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1020/2039] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:36 2021] PUT /identity/v3/projects/75a2ae36ab5c4513b0e9250ea74b32ff/users/f27ee9d973e54af2a5173bdf89fc34a6/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:36.379969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.412276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1020/2040] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:36.413096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.423634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd227b-969c-428f-851e-27b920ae5fbd None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.443847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d3401-a033-44c7-b1ac-7d7082bfc979 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.448941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.449604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.449907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.450204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.451008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:36.451323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.452972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63857-5d34-45fb-ab39-08d375431759 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.464964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1021/2041] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:36.466424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4a771-3c77-4167-86e6-13da992cfe22 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.466897 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4a771-3c77-4167-86e6-13da992cfe22 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.467435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4a771-3c77-4167-86e6-13da992cfe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.479936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.480848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.481126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.481399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] PATH_INFO: `/v3/projects/e5d8902c59aa496a95152e6e94c8e7cf/users/89e0f088b9ba49dc96c5cf55e8a3de8b/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.483857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d8902c59aa496a95152e6e94c8e7cf, user_id=89e0f088b9ba49dc96c5cf55e8a3de8b, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.486726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.486978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9ff4a771-3c77-4167-86e6-13da992cfe22 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:36.488223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9ff4a771-3c77-4167-86e6-13da992cfe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.497609 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1022/2042] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:36.499044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.499327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.499735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.502480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1021/2043] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:36 2021] PUT /identity/v3/projects/e5d8902c59aa496a95152e6e94c8e7cf/users/89e0f088b9ba49dc96c5cf55e8a3de8b/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:36.503305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.505466 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.528851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] MFA Rules not processed for user `f27ee9d973e54af2a5173bdf89fc34a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:36.530337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.572992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e9668-ccd8-4054-abff-10b636ec6f97 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.578445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.579146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.579482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.579698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.580415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.582394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.597646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1023/2044] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:36.598696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.611056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a6338-98d7-4ff7-a3a1-7ecbdb778d92 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.617161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c1378-07a7-48e0-87bd-c98894df371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.617838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1378-07a7-48e0-87bd-c98894df371b admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.618118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1378-07a7-48e0-87bd-c98894df371b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.618442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1378-07a7-48e0-87bd-c98894df371b admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.619174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c1378-07a7-48e0-87bd-c98894df371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.619339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1022/2045] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:36.620171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.621079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c1378-07a7-48e0-87bd-c98894df371b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.649135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1024/2046] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:36.650461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.650743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.651013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.680921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] MFA Rules not processed for user `89e0f088b9ba49dc96c5cf55e8a3de8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:36.682132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.691511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce169d-bebe-454f-9c02-00d2a576d4a2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.750281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.750970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.751248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.751541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.752276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:36.752580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.758302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.761935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1025/2047] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:36.763231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.766947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.771791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1023/2048] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:36.772834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.784442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5c6d4-e8ea-45b4-b661-8a59701879e1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.789359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.790045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.790356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.790630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.791374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.793332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.815989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1024/2049] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:36.816802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.828411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e46d7-6359-4789-8ce2-9a3253f94312 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.833103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.833773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.834049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.834355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.835066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.836986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.840204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b6340-db0e-4d2b-a6da-9177783f1344 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.844239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.844906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.845205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.845483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.859944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1025/2050] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:36.860782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.870882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355079-586b-4d79-b2ed-3cab671e66f7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:36.877737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:36.878419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:36.878915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:36.879050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:36.879691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.881642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.909309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1026/2051] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:36 2021] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:36.910177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.914102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:36.931583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:36.933081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:36.943594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1026/2052] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:36 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:36.944720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:36.959749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743327-3130-48a0-a539-19a41cd43a8e service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.001019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fa21b-4d38-40a5-a4d6-59b3262c5ff2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.005316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.007594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.007970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.008316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.046204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.046921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.047199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.047845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.048220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.049880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.065072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1027/2053] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:36 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:37.065072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.073887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a44a05-af83-4d22-8c5d-03b3f038ade7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.079818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.081162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.081162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.081162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.082020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.083727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.094812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.096381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.098607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1028/2054] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:37.099554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.112269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1027/2055] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:36 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:37.113730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963257-42d7-4cd0-bb33-37e79b8dd95d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.113910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.119828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.120666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.121016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.121294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.122364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.127420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.128556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873550-cd48-4e24-9e69-a80ca8784cf5 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.135419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.136341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.136854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.137854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.139103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.141684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.157857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1028/2056] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:37.159058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.167484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1029/2057] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/users => generated 294 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:37.167484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.172128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0878a35-1a0c-4e74-89ac-bd5eb65200cd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.177958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.178680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.178961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.179233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.180187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.180927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdfda4-6af1-4ec4-ad95-b4f08d081157 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.182769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.189501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.190712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.190993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.191447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] PATH_INFO: `/v3/projects/f26ee4e302c4404290f377cd2a961ee4/users/6da01289f6584760b291b505b33ea299/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.196186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1029/2058] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:37.197130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.209751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ce2b5-3a90-4a6d-8c5c-359fe8c6c8ea admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.221209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005e283-896b-4129-bcf4-c70a6a76cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.221896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005e283-896b-4129-bcf4-c70a6a76cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.222182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005e283-896b-4129-bcf4-c70a6a76cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.222488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005e283-896b-4129-bcf4-c70a6a76cc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.223270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005e283-896b-4129-bcf4-c70a6a76cc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.224938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005e283-896b-4129-bcf4-c70a6a76cc0d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.226359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26ee4e302c4404290f377cd2a961ee4, user_id=6da01289f6584760b291b505b33ea299, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.229239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.267177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1030/2059] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:37 2021] PUT /identity/v3/projects/f26ee4e302c4404290f377cd2a961ee4/users/6da01289f6584760b291b505b33ea299/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:37.267177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.267747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1030/2060] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:37.271344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.271344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.271344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.306216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] MFA Rules not processed for user `6da01289f6584760b291b505b33ea299`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:37.307621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:37.435525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7eba1-4113-45b9-bd50-dbff7f8a7646 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.449255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.461076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.461479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.461891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] PATH_INFO: `/v3/projects/7320b81930504951bbfd7828d8396af3/users/95faba77a19d43a5b7d57434729529b9/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.482350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7320b81930504951bbfd7828d8396af3, user_id=95faba77a19d43a5b7d57434729529b9, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.485801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.497811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1031/2061] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:37.499997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.509779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1031/2062] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:37 2021] PUT /identity/v3/projects/7320b81930504951bbfd7828d8396af3/users/95faba77a19d43a5b7d57434729529b9/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:37.518052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.525465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a4dc9-8514-4e16-8863-ac1838e449a0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.596998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900c96-3d1a-4ed1-8407-232f95771564 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.599771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.600748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.601178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.601455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.601545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.602104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.602270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.602417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.602687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.603907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.604586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:37.614669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1032/2063] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:37.615500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.626396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e39516-b147-4a7a-b48f-9dc2325a1742 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.632005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8908-4b17-4189-bb59-775c6fd5ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.632705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8908-4b17-4189-bb59-775c6fd5ac53 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.632932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8908-4b17-4189-bb59-775c6fd5ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.633214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8908-4b17-4189-bb59-775c6fd5ac53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.633930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8908-4b17-4189-bb59-775c6fd5ac53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.635893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8908-4b17-4189-bb59-775c6fd5ac53 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.667377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1033/2064] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:37.667377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.667377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.667377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.671414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.672902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.682668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1032/2065] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:37.683483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.694561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2e5f8-961c-42e8-9f22-dc214cf9f1d0 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.694870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] MFA Rules not processed for user `95faba77a19d43a5b7d57434729529b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:37.696414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:37.762575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.763762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.764112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.764397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] PATH_INFO: `/v3/projects/84999543c5c54deababa49882d6bb8a5/users/20844cb9e5ce4e9bbe1beb1afbc3a6a9/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.779953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84999543c5c54deababa49882d6bb8a5, user_id=20844cb9e5ce4e9bbe1beb1afbc3a6a9, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.781288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1034/2066] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:37.782210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.782681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.794359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a93c57-446f-4d99-9dca-3309eb77f284 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.800090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1033/2067] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:37 2021] PUT /identity/v3/projects/84999543c5c54deababa49882d6bb8a5/users/20844cb9e5ce4e9bbe1beb1afbc3a6a9/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:37.801358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.860208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd56fd1-71cf-4530-8302-d9ec7889de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.861430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56fd1-71cf-4530-8302-d9ec7889de18 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.861683 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56fd1-71cf-4530-8302-d9ec7889de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.862092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56fd1-71cf-4530-8302-d9ec7889de18 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.863050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd56fd1-71cf-4530-8302-d9ec7889de18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.865717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd56fd1-71cf-4530-8302-d9ec7889de18 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.874629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e318fc0-1f63-405e-8435-5c57e4bdce1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:37.881717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:37.882502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.882790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.883542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.884328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:37.886673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:37.890349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1035/2068] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:37.892385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:37.892385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:37.892677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:37.917250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1034/2069] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:37.918115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:37.924146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] MFA Rules not processed for user `20844cb9e5ce4e9bbe1beb1afbc3a6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:37.925274 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:38.013804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a29289-c3cf-44b1-b0a7-05fdc2ab5a67 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.022315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1036/2070] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:37 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:38.022519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.022620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.022692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.022692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.022692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.022692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.022692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.029584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843f825-20ac-4862-8f35-a77e0d909e44 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.034880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1035/2071] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:37 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:38.035986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.043159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.044814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.044814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.044814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.045551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.047633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.048895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7ac21-ed25-44f1-b7e0-b0f4f1cfc55f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.055113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.055787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.056118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.056538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.057147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.060374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.070004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1037/2072] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:38.070940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.081534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fb5e7-3e1c-4f73-989f-644d70d54903 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.088230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.089166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.089452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.089728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] PATH_INFO: `/v3/projects/396a157f2b7d4e6eb518a113c2f73092/users/3c45bcf699fa420195c57b210d1e57b5/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.097881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1036/2073] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:38.097881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.106430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=396a157f2b7d4e6eb518a113c2f73092, user_id=3c45bcf699fa420195c57b210d1e57b5, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.109879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.128190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1038/2074] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:38 2021] PUT /identity/v3/projects/396a157f2b7d4e6eb518a113c2f73092/users/3c45bcf699fa420195c57b210d1e57b5/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:38.131849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.163484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b290-7aff-40c6-91e7-8d16cca6398a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.195088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532254b6-787b-4215-8ff9-48290de5d1dc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.201812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.202770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.203021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.203640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.204114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.206294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.229961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1039/2075] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:38.233864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.236036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.237372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.237372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.237372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.238649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.240147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.251283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca262b88-1ba7-43ae-be8a-302890167e8c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.258479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.259219 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.259498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.259757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.260553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.262006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1037/2076] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:38.262256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.262914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.278012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1040/2077] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:38.278012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.278396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372251ed-bf7d-48a2-bd7c-4edc748f3b3a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.284465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.285750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.285942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.286140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.286923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.288695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.290868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e0fc8-32bb-499b-ba98-3c155a966131 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.296611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.297320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.297648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.297904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.298869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.300579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.307899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1038/2078] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:38.307899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.315023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b439f5-fd3c-47fd-ba89-a5904bb2889d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.318194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1041/2079] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:38.319083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.323478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.324412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.324700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.324991 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] PATH_INFO: `/v3/projects/396a157f2b7d4e6eb518a113c2f73092/users/3c45bcf699fa420195c57b210d1e57b5/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.327329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396a157f2b7d4e6eb518a113c2f73092, user_id=3c45bcf699fa420195c57b210d1e57b5, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.329534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b005-48ff-4fed-8fe7-9ef8efa10eec admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.330333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.334867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2034e-ab65-4027-91fa-3652108b18cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.335798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2034e-ab65-4027-91fa-3652108b18cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.336071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2034e-ab65-4027-91fa-3652108b18cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.336343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2034e-ab65-4027-91fa-3652108b18cf admin admin] PATH_INFO: `/v3/projects/3b472a1553aa489e98772210ee992d40/users/1b9ae1f60d204b0a9025c150e63b64ad/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.341413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1039/2080] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:38 2021] PUT /identity/v3/projects/396a157f2b7d4e6eb518a113c2f73092/users/3c45bcf699fa420195c57b210d1e57b5/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:38.342282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.354703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2034e-ab65-4027-91fa-3652108b18cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b472a1553aa489e98772210ee992d40, user_id=1b9ae1f60d204b0a9025c150e63b64ad, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.357731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2034e-ab65-4027-91fa-3652108b18cf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.375432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1042/2081] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:38 2021] PUT /identity/v3/projects/3b472a1553aa489e98772210ee992d40/users/1b9ae1f60d204b0a9025c150e63b64ad/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:38.377042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.377317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.377588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.412187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] MFA Rules not processed for user `3c45bcf699fa420195c57b210d1e57b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:38.413615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:38.506598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1043/2082] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:38.507461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.567389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0edfe2-8575-45b0-9df4-6dba6c9a5857 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.601551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69915a4-c19a-4289-8b85-0706da1e2991 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.608198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.608993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.609526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.609823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.611509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.614185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.635646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1044/2083] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:38.637063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.654833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.655839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.656189 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.656532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] PATH_INFO: `/v3/projects/e81f5283590943c1a876f5efb9390cbf/users/cfd025bd75a949a3a4c2f4e26bb9f93d/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.677559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81f5283590943c1a876f5efb9390cbf, user_id=cfd025bd75a949a3a4c2f4e26bb9f93d, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.680900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.698448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1040/2084] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:38 2021] PUT /identity/v3/projects/e81f5283590943c1a876f5efb9390cbf/users/cfd025bd75a949a3a4c2f4e26bb9f93d/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:38.699520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.753640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e6e5-9f3e-44a2-a6a9-d96730307ed6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.797647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343e3d-226e-4cc9-a909-1a12cdfa7948 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:38.803865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44c01-7dda-4742-91c2-150b53ad2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.815028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44c01-7dda-4742-91c2-150b53ad2c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.815240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44c01-7dda-4742-91c2-150b53ad2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.815532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44c01-7dda-4742-91c2-150b53ad2c28 admin admin] PATH_INFO: `/v3/projects/3b472a1553aa489e98772210ee992d40/users/1b9ae1f60d204b0a9025c150e63b64ad/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.818408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44c01-7dda-4742-91c2-150b53ad2c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b472a1553aa489e98772210ee992d40, user_id=1b9ae1f60d204b0a9025c150e63b64ad, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.822134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44c01-7dda-4742-91c2-150b53ad2c28 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.823497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc09e7-8b16-413b-ae11-961c35ecd22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:38.824616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc09e7-8b16-413b-ae11-961c35ecd22d service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.825489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc09e7-8b16-413b-ae11-961c35ecd22d service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.826457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc09e7-8b16-413b-ae11-961c35ecd22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.838948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1041/2085] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:38 2021] PUT /identity/v3/projects/3b472a1553aa489e98772210ee992d40/users/1b9ae1f60d204b0a9025c150e63b64ad/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:38.840416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.840712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.840993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.883262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] MFA Rules not processed for user `cfd025bd75a949a3a4c2f4e26bb9f93d`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:38.884578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:38.929638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc09e7-8b16-413b-ae11-961c35ecd22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:38.931473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc09e7-8b16-413b-ae11-961c35ecd22d service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:38.942046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1045/2086] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:38 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:38.943398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:38.943688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:38.943971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:38.970027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1042/2087] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:38.971396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:38.973218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] MFA Rules not processed for user `1b9ae1f60d204b0a9025c150e63b64ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:38.974665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:39.055502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b124ffb-9188-4659-9050-b7163bf1f08a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.060735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.061455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.061732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.062061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.062737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.064640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.075478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1046/2088] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:39.080809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.097594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1043/2089] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:38 2021] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:39.097594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.141368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca8f6b-04ed-4379-9c17-aadfbf813a9e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.152526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba0ba-0820-4242-8fe7-121912b5bb3a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.156781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.157450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.157728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.157997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.190471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.191122 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.191400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.191671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.224431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.225993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.237771 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1044/2090] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:39 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:39.238657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.272994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.274830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.286182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1047/2091] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:39 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:39.319507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5228-2517-4b5b-bc1e-b656c2ab3183 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.333852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.334622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.335029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.335401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.336183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.338766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.361355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1045/2092] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:39 2021] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:39.365411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.381781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dcb92-a30a-40aa-a582-5958b467d59f service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.386781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.387533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.387922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.388204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.389238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.390875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.403316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1048/2093] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:39.407303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.418367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b4699-1390-4560-aebb-8bd9456f3ce9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.424909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.425811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.426081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.426396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] PATH_INFO: `/v3/projects/2a1951a62c5443e7ab85faf3731bf3dd/users/ae19c8d02cc4469ca67d36dd39390751/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.444250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1951a62c5443e7ab85faf3731bf3dd, user_id=ae19c8d02cc4469ca67d36dd39390751, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.447539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.466095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1046/2094] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:39 2021] PUT /identity/v3/projects/2a1951a62c5443e7ab85faf3731bf3dd/users/ae19c8d02cc4469ca67d36dd39390751/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:39.470040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.481076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda5715-c924-4378-ae48-2367ebeb989f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.547749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7c302-25ea-44e0-9c0a-531c020878e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.549488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7c302-25ea-44e0-9c0a-531c020878e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.549888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7c302-25ea-44e0-9c0a-531c020878e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.550252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7c302-25ea-44e0-9c0a-531c020878e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.554461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7c302-25ea-44e0-9c0a-531c020878e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.554461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7c302-25ea-44e0-9c0a-531c020878e4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.569711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1049/2095] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:39.576839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.591766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20f65a-1a54-4940-acfa-a7b111ff1c6b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.598187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.599264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.599544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.599816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] PATH_INFO: `/v3/projects/2a1951a62c5443e7ab85faf3731bf3dd/users/ae19c8d02cc4469ca67d36dd39390751/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.601998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1951a62c5443e7ab85faf3731bf3dd, user_id=ae19c8d02cc4469ca67d36dd39390751, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:39.604960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:39.616540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1047/2096] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:39 2021] PUT /identity/v3/projects/2a1951a62c5443e7ab85faf3731bf3dd/users/ae19c8d02cc4469ca67d36dd39390751/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:39.635445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.635964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.636427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:39.680427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] MFA Rules not processed for user `ae19c8d02cc4469ca67d36dd39390751`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:39.682074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:39.795632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1050/2097] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:39 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:39.809693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:39.918739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec194-a631-486d-8428-98144d41450d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:39.924025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7577ba-5942-4f8d-ab67-0bebc3a9cc5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:39.925204 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7577ba-5942-4f8d-ab67-0bebc3a9cc5d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:39.925825 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7577ba-5942-4f8d-ab67-0bebc3a9cc5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:39.926258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7577ba-5942-4f8d-ab67-0bebc3a9cc5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:40.042147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7577ba-5942-4f8d-ab67-0bebc3a9cc5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:40.045028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7577ba-5942-4f8d-ab67-0bebc3a9cc5d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:40.056660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1048/2098] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:39 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:40.217667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:40.288289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7d26c-da7a-482d-add7-c2d157d15f09 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:40.293192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:40.294092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:40.294433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:40.294825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] PATH_INFO: `/v3/users/20844cb9e5ce4e9bbe1beb1afbc3a6a9` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:40.296275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20844cb9e5ce4e9bbe1beb1afbc3a6a9)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:40.298332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:40.349872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20844cb9e5ce4e9bbe1beb1afbc3a6a9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.350459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20844cb9e5ce4e9bbe1beb1afbc3a6a9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.351091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20844cb9e5ce4e9bbe1beb1afbc3a6a9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.360217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20844cb9e5ce4e9bbe1beb1afbc3a6a9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.376324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20844cb9e5ce4e9bbe1beb1afbc3a6a9'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.390086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1051/2099] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:40 2021] DELETE /identity/v3/users/20844cb9e5ce4e9bbe1beb1afbc3a6a9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:40.398819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:40.399215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:40.399543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:40.418544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:40.419818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:40.481858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1049/2100] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:40.493169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:40.494703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:40.558283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbfc81-d1c5-454d-a91f-48229d095604 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:40.562524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:40.563184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:40.563467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:40.563749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:40.573978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:40.575359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:40.584911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1052/2101] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:40.862412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:40.863853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:40.878823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70b90-fff8-46f9-8310-6cd600b2beb4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:40.895605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:40.897483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:40.897869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:40.898101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] PATH_INFO: `/v3/projects/84999543c5c54deababa49882d6bb8a5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:40.900150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=84999543c5c54deababa49882d6bb8a5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:40.902520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:40.958697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84999543c5c54deababa49882d6bb8a5', 'request_id': 'req-9e07ab68-249a-4918-9214-e24e8b0920ff'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.967749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84999543c5c54deababa49882d6bb8a5', 'request_id': 'req-9e07ab68-249a-4918-9214-e24e8b0920ff'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.973454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84999543c5c54deababa49882d6bb8a5', 'request_id': 'req-9e07ab68-249a-4918-9214-e24e8b0920ff'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.984584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] The token cache is being invalidate because project 84999543c5c54deababa49882d6bb8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:40.984869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.985527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:40.987188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1050/2102] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:40 2021] DELETE /identity/v3/projects/84999543c5c54deababa49882d6bb8a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:40.991572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:41.002282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278ef97-daa9-4e68-9e0f-c0d73f76390d service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:41.076477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:41.077501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:41.077772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:41.078619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] PATH_INFO: `/v3/users/1b9ae1f60d204b0a9025c150e63b64ad` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:41.079422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9ae1f60d204b0a9025c150e63b64ad)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:41.081516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:41.159685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9ae1f60d204b0a9025c150e63b64ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.160736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9ae1f60d204b0a9025c150e63b64ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.161662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9ae1f60d204b0a9025c150e63b64ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.177368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9ae1f60d204b0a9025c150e63b64ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.198746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ec972e2-3a87-4360-a358-f38b64d33ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9ae1f60d204b0a9025c150e63b64ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.216113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1053/2103] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:40 2021] DELETE /identity/v3/users/1b9ae1f60d204b0a9025c150e63b64ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:41.526698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:41.528333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:41.544246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ab68-249a-4918-9214-e24e8b0920ff admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:41.618350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:41.619115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:41.619393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:41.619665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] PATH_INFO: `/v3/projects/3b472a1553aa489e98772210ee992d40` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:41.620930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b472a1553aa489e98772210ee992d40)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:41.623177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:41.677069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b472a1553aa489e98772210ee992d40', 'request_id': 'req-24cd9afd-af18-4798-bb35-6e76925c6cb6'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.686352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b472a1553aa489e98772210ee992d40', 'request_id': 'req-24cd9afd-af18-4798-bb35-6e76925c6cb6'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.693421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b472a1553aa489e98772210ee992d40', 'request_id': 'req-24cd9afd-af18-4798-bb35-6e76925c6cb6'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.705749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] The token cache is being invalidate because project 3b472a1553aa489e98772210ee992d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:41.706042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.707316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-24cd9afd-af18-4798-bb35-6e76925c6cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:41.709139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1051/2104] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:41 2021] DELETE /identity/v3/projects/3b472a1553aa489e98772210ee992d40 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:41.715478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:41.716140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:41.716140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:41.735291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:41.736715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:41.812912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1054/2105] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:41.821948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:41.822356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:41.822559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:41.845758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:41.847111 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:41.860257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1052/2106] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:41.861946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:41.873371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64852430-d246-4737-a8f0-ef05e21b4499 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:41.878945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:41.879768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:41.880218 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:41.880669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:41.881961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:41.882485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:41.885348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:41.908144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1055/2107] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:55:41.913927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:41.926351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04e27-1dc2-4482-a1ba-b775e1d225e3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:41.932719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:41.933553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:41.933898 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:41.934239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:41.936078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:41.938585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:41.976213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1053/2108] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:41 2021] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:41.980318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:41.993162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39706-85cf-4de8-a0b6-df0cf59d00f2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.061988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.062759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.063029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.063301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.064033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.066004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.096528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1056/2109] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:41 2021] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:42.101094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.116750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353f98a-02e1-4443-adb3-f348db41f7cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.122877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.123634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.123857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.124121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.124907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.126648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.138563 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1054/2110] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:42.143374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.155199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6ee66-4881-4cbc-916e-d56789bdd276 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.160733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4732d0-129c-471c-89e3-0bef5f2f4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.161438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4732d0-129c-471c-89e3-0bef5f2f4127 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.161715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4732d0-129c-471c-89e3-0bef5f2f4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.162006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4732d0-129c-471c-89e3-0bef5f2f4127 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.162785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4732d0-129c-471c-89e3-0bef5f2f4127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.164417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4732d0-129c-471c-89e3-0bef5f2f4127 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.176405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1057/2111] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:42.182604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.194480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049e1ad-21e6-48f6-86ad-90f334cfd1a7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.199961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.201032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.201312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.201584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] PATH_INFO: `/v3/projects/5d18832a36424d7bac50a8de07592680/users/37ca1e793f8f486ca839029542a1d765/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.225957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d18832a36424d7bac50a8de07592680, user_id=37ca1e793f8f486ca839029542a1d765, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.230427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.262048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1055/2112] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:42 2021] PUT /identity/v3/projects/5d18832a36424d7bac50a8de07592680/users/37ca1e793f8f486ca839029542a1d765/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:42.274125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.275012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.275012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.308369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] MFA Rules not processed for user `37ca1e793f8f486ca839029542a1d765`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:42.310026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:42.391039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1058/2113] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:42 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:42.396356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.540234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11f14-ac84-4c58-a135-1ed2571aaf08 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.547360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.548056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.548571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.549278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.550227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.552681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.602967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1056/2114] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:42 2021] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:42.609282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.629817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2776d68-f014-40a5-9b5f-4feb481ece3f None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.720232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.720990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.721324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.721608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.722675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.724727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.759914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1059/2115] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:42 2021] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:42.769005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.775253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.776968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:42.781858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880c49f-2ad6-4c4c-a9a2-5542f7f3764d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.789248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.790950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.791463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.791967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.793040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.795311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.809950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1057/2116] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:55:42.814629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.825786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e44e7-499c-4b1e-b6d3-c3a59ee7f23f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.831279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.832383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.832853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.833128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] PATH_INFO: `/v3/projects/8b60e47ba75a45769d79837628dfdae0/users/4bba76f8710342c09a29b0c4d238bd22/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.843310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a392e-0bc2-4bd7-aa90-11fe47ddce63 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:42.847451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:42.848655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:42.848938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:42.849232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:42.849380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b60e47ba75a45769d79837628dfdae0, user_id=4bba76f8710342c09a29b0c4d238bd22, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.851751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:42.851927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.870823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1058/2117] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:42 2021] PUT /identity/v3/projects/8b60e47ba75a45769d79837628dfdae0/users/4bba76f8710342c09a29b0c4d238bd22/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:42.875375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:42.965691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:42.968894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:42.989940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1060/2118] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:42 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:43.015186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52399d-c9f2-4304-99bd-d304a903876e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:43.032718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587586ac-7f4f-42b5-bd7f-12271e062664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:43.034290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587586ac-7f4f-42b5-bd7f-12271e062664 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:43.045654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587586ac-7f4f-42b5-bd7f-12271e062664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:43.046296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587586ac-7f4f-42b5-bd7f-12271e062664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:43.047747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587586ac-7f4f-42b5-bd7f-12271e062664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:43.058392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587586ac-7f4f-42b5-bd7f-12271e062664 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:43.074047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1059/2119] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:43.087149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:43.112921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900796f-ec41-416b-98fd-a9e9f83dee8b service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:43.121477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:43.123243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:43.123731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:43.124206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] PATH_INFO: `/v3/projects/8b60e47ba75a45769d79837628dfdae0/users/4bba76f8710342c09a29b0c4d238bd22/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:43.127918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b60e47ba75a45769d79837628dfdae0, user_id=4bba76f8710342c09a29b0c4d238bd22, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:43.133312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:43.154615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1061/2120] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:43 2021] PUT /identity/v3/projects/8b60e47ba75a45769d79837628dfdae0/users/4bba76f8710342c09a29b0c4d238bd22/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:43.167058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:43.167339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:43.167503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:43.202466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] MFA Rules not processed for user `4bba76f8710342c09a29b0c4d238bd22`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:43.203740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:43.321190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1060/2121] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:43 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:43.465861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:43.468147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:43.566071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2233-baa2-4481-a2f4-b5cf40675ec0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:43.573809 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:43.574983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:43.575438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:43.576517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:43.701866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:43.704471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:43.734529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1062/2122] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:43 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:44.192293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:44.197790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:44.339358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:44.360255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe40d0-6891-44b6-93df-34e626e3bece service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:44.372395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dcb1a-736b-41ac-af7a-1919a4f5c20a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:44.379153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:44.380903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:44.383340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:44.383923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:44.390379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:44.391542 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:44.395192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:44.397384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:44.398000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] PATH_INFO: `/v3/users/9ed9506743464c3ea545f46c78e3a52a` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:44.402331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed9506743464c3ea545f46c78e3a52a)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:44.415000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:44.528891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed9506743464c3ea545f46c78e3a52a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.529932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed9506743464c3ea545f46c78e3a52a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.530901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed9506743464c3ea545f46c78e3a52a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.550637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed9506743464c3ea545f46c78e3a52a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.554529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:44.557272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:44.571637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1063/2123] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:44 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:44.571916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-74ef6071-07c7-43bb-b2f6-5c01e6b0d7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed9506743464c3ea545f46c78e3a52a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.572689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:44.574814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:44.594196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1061/2124] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:44 2021] DELETE /identity/v3/users/9ed9506743464c3ea545f46c78e3a52a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:44.597970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbea4a-ce90-4471-b8e5-2060dd0c739c service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:44.600824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:44.601494 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:44.602000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:44.645826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:44.647456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:44.737108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:44.738718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:44.739266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:44.739707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] PATH_INFO: `/v3/users/214880bcabcd45dd89753e769ca07220` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:44.741628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214880bcabcd45dd89753e769ca07220)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:44.744032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:44.770950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1062/2125] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:44.781823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:44.784619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:44.813498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214880bcabcd45dd89753e769ca07220'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.815144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214880bcabcd45dd89753e769ca07220'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.816159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214880bcabcd45dd89753e769ca07220'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.829230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214880bcabcd45dd89753e769ca07220'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.847625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214880bcabcd45dd89753e769ca07220'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:44.862997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1064/2126] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:44 2021] DELETE /identity/v3/users/214880bcabcd45dd89753e769ca07220 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:44.873969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee86c2-7b14-4438-a175-1a08472ec75e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:44.963959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:44.964766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:44.965142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:44.965505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:44.968390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.065428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.068466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604f06-c313-4fdc-a2a1-e80fb86d770d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.085869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1063/2127] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:45.281412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.283279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.301279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55d40-1333-475e-9774-4daa6ec9a0d7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.307123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.308056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.308394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.308878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] PATH_INFO: `/v3/projects/957858dcc5384487a7ef337124998c1b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.311541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=957858dcc5384487a7ef337124998c1b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.315555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.402697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957858dcc5384487a7ef337124998c1b', 'request_id': 'req-9ebf4300-717a-4f53-b3c6-dadde294ca5f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.412963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957858dcc5384487a7ef337124998c1b', 'request_id': 'req-9ebf4300-717a-4f53-b3c6-dadde294ca5f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.421868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957858dcc5384487a7ef337124998c1b', 'request_id': 'req-9ebf4300-717a-4f53-b3c6-dadde294ca5f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.435477 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] The token cache is being invalidate because project 957858dcc5384487a7ef337124998c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:45.435806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.436476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9ebf4300-717a-4f53-b3c6-dadde294ca5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.438243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1065/2128] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:45 2021] DELETE /identity/v3/projects/957858dcc5384487a7ef337124998c1b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:45.447479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.448011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.448510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.480466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:45.482974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.597216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1064/2129] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:45.610951 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.611257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.611482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.636631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:45.638060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.654272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1066/2130] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:45.657506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.672289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7b41-8f62-443c-a0f0-f4784cbcae85 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.678334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.679274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.679753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.680259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.681426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:45.681891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.684451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.684754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.686670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.698653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1065/2131] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:45.704016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.708884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f065c-be5c-4b6c-aa5c-9ff95b61c104 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.716308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.717236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.717559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.717884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] PATH_INFO: `/v3/projects/f8a3ff37ddd5406a97963047cc03b59c` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.719532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a3ff37ddd5406a97963047cc03b59c)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.721472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ff386-7816-4d0a-a5dc-97e8ed48d401 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.721703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.731055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.732198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.732640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.733082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.734560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.738470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.787414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a3ff37ddd5406a97963047cc03b59c', 'request_id': 'req-bdf0f692-a279-4382-bfc0-990131527ab1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.800968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1066/2132] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:45 2021] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:45.803129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.804559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a3ff37ddd5406a97963047cc03b59c', 'request_id': 'req-bdf0f692-a279-4382-bfc0-990131527ab1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.817282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a3ff37ddd5406a97963047cc03b59c', 'request_id': 'req-bdf0f692-a279-4382-bfc0-990131527ab1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.841945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] The token cache is being invalidate because project f8a3ff37ddd5406a97963047cc03b59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:45.842822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.846548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:45.848765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1067/2133] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:45 2021] DELETE /identity/v3/projects/f8a3ff37ddd5406a97963047cc03b59c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:45.852974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.854553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.907828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bedfc-0c84-4257-9573-38b254b326b6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.917074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.918296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.918803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.919348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.920737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.924816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.931522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f692-a279-4382-bfc0-990131527ab1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.936990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.937896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.938193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.938485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] PATH_INFO: `/v3/users/89e0f088b9ba49dc96c5cf55e8a3de8b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.939750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e0f088b9ba49dc96c5cf55e8a3de8b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.942532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.957721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1067/2134] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:45 2021] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:45.958560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:45.960421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:45.973872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ec88-a1ee-4795-873e-b383ed1400cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:45.979926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:45.980789 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:45.981340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:45.981704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:45.982752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:45.984688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:45.997270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1068/2135] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:45 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:46.002702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:46.008177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e0f088b9ba49dc96c5cf55e8a3de8b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.008883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e0f088b9ba49dc96c5cf55e8a3de8b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.009495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e0f088b9ba49dc96c5cf55e8a3de8b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.015997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400401-23ca-4eed-9548-415177fd793e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:46.020910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e0f088b9ba49dc96c5cf55e8a3de8b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.023511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:46.024598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.024937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.025283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.026299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:46.028509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:46.038464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2579f28f-a096-4d55-9835-acb12794b66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e0f088b9ba49dc96c5cf55e8a3de8b'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.050888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1069/2136] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:46 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:46.054661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1068/2137] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:45 2021] DELETE /identity/v3/users/89e0f088b9ba49dc96c5cf55e8a3de8b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:46.056782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:46.060635 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:46.082306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c348960-ca05-4be3-9040-7d25fab8148b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:46.162753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:46.163676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.163962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.164293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] PATH_INFO: `/v3/projects/e776c427146842c1ba9637dc29f7281e/users/d50d9103fa7d4f74bd77defac782f225/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.181293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e776c427146842c1ba9637dc29f7281e, user_id=d50d9103fa7d4f74bd77defac782f225, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:46.184054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:46.202135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1070/2138] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:46 2021] PUT /identity/v3/projects/e776c427146842c1ba9637dc29f7281e/users/d50d9103fa7d4f74bd77defac782f225/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:46.208520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.209662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.210044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.234272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:46.235569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:46.364102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1069/2139] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:46.397065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:46.399016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:46.485198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:46.489354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:46.514223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892df83-defc-4522-9196-cbb81bcdf2e1 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:46.525130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:46.527067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.527949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.529751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] PATH_INFO: `/v3/projects/e5d8902c59aa496a95152e6e94c8e7cf` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.532820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d8902c59aa496a95152e6e94c8e7cf)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:46.536913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:46.552048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed0f6-0bb8-4c5f-b549-17d15db8b7ec admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:46.557201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2028aa-0691-4512-a44d-d5d68e5e8085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:46.558787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2028aa-0691-4512-a44d-d5d68e5e8085 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.559080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2028aa-0691-4512-a44d-d5d68e5e8085 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.559458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2028aa-0691-4512-a44d-d5d68e5e8085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.574203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2028aa-0691-4512-a44d-d5d68e5e8085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:46.577175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2028aa-0691-4512-a44d-d5d68e5e8085 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:46.601858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1071/2140] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:46.628939 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d8902c59aa496a95152e6e94c8e7cf', 'request_id': 'req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.639413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d8902c59aa496a95152e6e94c8e7cf', 'request_id': 'req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.647708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d8902c59aa496a95152e6e94c8e7cf', 'request_id': 'req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.661768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] The token cache is being invalidate because project e5d8902c59aa496a95152e6e94c8e7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:46.662054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.662933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4c2a0d74-1070-4db9-9a62-d07a16a58aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:46.665215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1070/2141] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:46 2021] DELETE /identity/v3/projects/e5d8902c59aa496a95152e6e94c8e7cf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:46.672270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.672777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.673351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.702870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:46.705037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:46.796969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1072/2142] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:46.813382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.814636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.815031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.869593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:46.873142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:46.891384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1071/2143] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:46.898941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:46.928050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca3b45-e659-4b38-a339-0e6627f2a803 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:46.939496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:46.940863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:46.941480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:46.953032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:46.957163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:46.957163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:46.959485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:46.977869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1073/2144] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:46.984567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.003525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089636d4-3d8e-47bb-8e76-c61f4d3ec12c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:47.012058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:47.013222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.013631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.014180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.015419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:47.019482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:47.069142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1072/2145] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:46 2021] POST /identity/v3/projects => generated 407 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:47.078557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.101132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2540-3cda-433f-bd73-b75fb985d754 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:47.231364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:47.233074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.233550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.234029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.235504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:47.239371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:47.269570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1074/2146] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:47 2021] POST /identity/v3/users => generated 304 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:47.274461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.294790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013ab1-5cbc-4947-a764-a13fd76da039 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:47.303360 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:47.304485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.305143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.305656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.307241 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:47.310664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:47.336659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1073/2147] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:47 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:47.338435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.351618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14273-3a1b-4fd4-9bce-1e2ec65d430d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:47.358264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe87c3a-702f-4b7d-8f4a-fb71592ba2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:47.358997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87c3a-702f-4b7d-8f4a-fb71592ba2cb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.359282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87c3a-702f-4b7d-8f4a-fb71592ba2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.359561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87c3a-702f-4b7d-8f4a-fb71592ba2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.360343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe87c3a-702f-4b7d-8f4a-fb71592ba2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:47.362501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe87c3a-702f-4b7d-8f4a-fb71592ba2cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:47.375547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1075/2148] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:47 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:55:47.382214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.394025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2ae9-3139-4bfb-93c0-bce10796ce9a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:47.399662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17ab19-253e-48d6-8cc7-cf0d87598d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:47.400591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17ab19-253e-48d6-8cc7-cf0d87598d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.400878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17ab19-253e-48d6-8cc7-cf0d87598d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.401172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17ab19-253e-48d6-8cc7-cf0d87598d08 admin admin] PATH_INFO: `/v3/projects/fc8e5804dc2f4540ae83921e11861afb/users/f1e276220b324164b1821461efbd8869/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.427153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17ab19-253e-48d6-8cc7-cf0d87598d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8e5804dc2f4540ae83921e11861afb, user_id=f1e276220b324164b1821461efbd8869, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:47.432676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17ab19-253e-48d6-8cc7-cf0d87598d08 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:47.457488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1074/2149] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:47 2021] PUT /identity/v3/projects/fc8e5804dc2f4540ae83921e11861afb/users/f1e276220b324164b1821461efbd8869/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:47.476637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.477137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.477650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.529083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] MFA Rules not processed for user `f1e276220b324164b1821461efbd8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:47.531525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:47.614098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be519-8af3-41fc-87b3-c971f9e29247 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.614593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be519-8af3-41fc-87b3-c971f9e29247 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.614968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be519-8af3-41fc-87b3-c971f9e29247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.650038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0c1be519-8af3-41fc-87b3-c971f9e29247 None None] MFA Rules not processed for user `d50d9103fa7d4f74bd77defac782f225`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:47.651668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0c1be519-8af3-41fc-87b3-c971f9e29247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:47.744268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1075/2150] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:47.745984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.746409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.746796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.767713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] MFA Rules not processed for user `d50d9103fa7d4f74bd77defac782f225`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:47.769316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:47.779117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1076/2151] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:47.799038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.800942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:47.820792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1076/2152] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:47 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:47.827649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:47.965336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca0639-c144-485c-b44d-fa49fc2dcef3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:47.977442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:47.978956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:47.979719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:47.980159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:47.990119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:47.992696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.007631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1077/2153] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:48.097101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81de5-3b8e-461a-9af5-adb383bd8a9e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.126645 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.127758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.128515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.128764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.130152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.137882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.229299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1077/2154] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:47 2021] POST /identity/v3/projects => generated 407 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:48.234288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.258536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4280d-9767-49f0-9e32-763b6025a6da service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.360360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.363772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:48.406649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.407476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.407998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.408804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.410110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.416494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.465460 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1078/2155] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:48 2021] POST /identity/v3/users => generated 310 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:48.471785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.485236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967faf0-f5a7-4e73-b01b-733c46cba4ae admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.495794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.496974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.498250 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.498855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.501050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.503805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.528139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1079/2156] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:48 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:48.530365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.536263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26d12-6b5b-40ff-ba2e-e63fce46705e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.547367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7c25-beda-4b0b-8a14-4b0a3220e5bd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.547815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.549695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.550514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.551142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] PATH_INFO: `/v3/users/38fb120cca364f3e8ce51e901206271e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.553910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fb120cca364f3e8ce51e901206271e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.554978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.555958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.556332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.556620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] PATH_INFO: `/v3/projects/2977596813784681a72697e496f0921c/users/7ea4e0f210aa43b3a1816911c7df5f8f/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.559286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.580811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2977596813784681a72697e496f0921c, user_id=7ea4e0f210aa43b3a1816911c7df5f8f, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.584156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.605561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1080/2157] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:48 2021] PUT /identity/v3/projects/2977596813784681a72697e496f0921c/users/7ea4e0f210aa43b3a1816911c7df5f8f/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:48.610561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.683591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fb120cca364f3e8ce51e901206271e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:48.686061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fb120cca364f3e8ce51e901206271e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:48.687902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fb120cca364f3e8ce51e901206271e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:48.701559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3116ab-bef5-4477-a5ef-c0a7a50c59e7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.702920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fb120cca364f3e8ce51e901206271e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:48.709488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.710261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.710567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.710844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.712092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.713855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.733543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1081/2158] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:48 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:48.734514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.736847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:48.736994 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6a7eb67b-7034-41eb-bf38-c942512f6bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fb120cca364f3e8ce51e901206271e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:48.756163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1f6b-be45-4bb6-bcf1-56e7369a113c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:48.762199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417da7e7-6d3f-4152-a4eb-22d289691010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:48.763143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da7e7-6d3f-4152-a4eb-22d289691010 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.763425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da7e7-6d3f-4152-a4eb-22d289691010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.763708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da7e7-6d3f-4152-a4eb-22d289691010 admin admin] PATH_INFO: `/v3/projects/2977596813784681a72697e496f0921c/users/7ea4e0f210aa43b3a1816911c7df5f8f/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.763810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1078/2159] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:48 2021] DELETE /identity/v3/users/38fb120cca364f3e8ce51e901206271e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:48.766452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417da7e7-6d3f-4152-a4eb-22d289691010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2977596813784681a72697e496f0921c, user_id=7ea4e0f210aa43b3a1816911c7df5f8f, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:48.769920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.770229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.770325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417da7e7-6d3f-4152-a4eb-22d289691010 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:48.770514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.790283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1082/2160] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:48 2021] PUT /identity/v3/projects/2977596813784681a72697e496f0921c/users/7ea4e0f210aa43b3a1816911c7df5f8f/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:48.792265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:48.793698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:48.800341 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:48.800790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:48.801200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:48.849587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] MFA Rules not processed for user `7ea4e0f210aa43b3a1816911c7df5f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:48.850878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:48.912480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1079/2161] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:48.927516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.930030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:48.976910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1083/2162] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:48 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:48.987990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:48.989450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:49.038928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe418a-58d0-4c86-ac3d-1e0ca84a2872 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:49.046870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:49.047834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:49.048122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:49.048529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:49.061743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:49.063251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:49.077811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1080/2163] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:49.110016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2581d-8133-4418-b743-e1ca0c5fe781 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:49.148256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3b2cb-ea6d-42d8-bb86-161f8a984303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:49.149445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3b2cb-ea6d-42d8-bb86-161f8a984303 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:49.149920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3b2cb-ea6d-42d8-bb86-161f8a984303 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:49.150455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3b2cb-ea6d-42d8-bb86-161f8a984303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:49.173397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3b2cb-ea6d-42d8-bb86-161f8a984303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:49.176460 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3b2cb-ea6d-42d8-bb86-161f8a984303 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:49.198077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1084/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:48 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:55:49.232791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:49.234683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:49.278895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c621-01bd-4896-a2ba-2b8f4683dff2 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:49.296051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:49.297649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:49.298145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:49.298668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] PATH_INFO: `/v3/users/37ca1e793f8f486ca839029542a1d765` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:49.301084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ca1e793f8f486ca839029542a1d765)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:49.305723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:49.456954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ca1e793f8f486ca839029542a1d765'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:49.462328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ca1e793f8f486ca839029542a1d765'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:49.466977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ca1e793f8f486ca839029542a1d765'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:49.492168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ca1e793f8f486ca839029542a1d765'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:49.532126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ca1e793f8f486ca839029542a1d765'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:49.562970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1081/2165] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:49 2021] DELETE /identity/v3/users/37ca1e793f8f486ca839029542a1d765 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:49.568557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:49.569773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:49.570534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:49.627489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:49.630798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:49.664119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:49.673391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:49.814971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1085/2166] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:49.830485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:49.833560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:49.837990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b0b8b-a02c-47fb-aff2-e25d2e70b8cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:49.862115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:49.862787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:49.863067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:49.863438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:49.873320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:49.939806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98203ae9-70c0-4444-a01d-be79d73501fa None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:49.952487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:49.953920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:49.956472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:49.956942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:49.988287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:49.990758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:50.007956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1086/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:50.010307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:50.013435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:50.038852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1aaa2-0666-4af1-ac8b-d2c0974dd35d service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:50.051436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:50.052504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:50.053225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:50.053735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] PATH_INFO: `/v3/projects/31e44127c6c747bbbe831e3ebc7dc944` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:50.058918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e44127c6c747bbbe831e3ebc7dc944)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:50.063204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:50.092747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:50.094696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:50.141250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1082/2168] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:49 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:50.262755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e44127c6c747bbbe831e3ebc7dc944', 'request_id': 'req-bfda2e6b-d7ae-433a-89b6-f5186df7193d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.281045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e44127c6c747bbbe831e3ebc7dc944', 'request_id': 'req-bfda2e6b-d7ae-433a-89b6-f5186df7193d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.338191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e44127c6c747bbbe831e3ebc7dc944', 'request_id': 'req-bfda2e6b-d7ae-433a-89b6-f5186df7193d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.392012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] The token cache is being invalidate because project 31e44127c6c747bbbe831e3ebc7dc944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:50.392906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.394439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.399157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1087/2169] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:50 2021] DELETE /identity/v3/projects/31e44127c6c747bbbe831e3ebc7dc944 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:50.404215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:50.425134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ee82-715f-4bb7-b357-e0ed6957cbcb service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:50.596198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:50.598706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:50.599265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:50.599861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] PATH_INFO: `/v3/users/6da01289f6584760b291b505b33ea299` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:50.601633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da01289f6584760b291b505b33ea299)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:50.605005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:50.726086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:50.729138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:50.743225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da01289f6584760b291b505b33ea299'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.747778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da01289f6584760b291b505b33ea299'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.749165 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da01289f6584760b291b505b33ea299'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.767699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da01289f6584760b291b505b33ea299'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.783832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda2e6b-d7ae-433a-89b6-f5186df7193d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:50.791270 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:50.792283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:50.792568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:50.792961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] PATH_INFO: `/v3/projects/5d18832a36424d7bac50a8de07592680` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:50.794502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d18832a36424d7bac50a8de07592680)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:50.796609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:50.799712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da01289f6584760b291b505b33ea299'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.846658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1083/2170] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:50 2021] DELETE /identity/v3/users/6da01289f6584760b291b505b33ea299 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:50.907749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d18832a36424d7bac50a8de07592680', 'request_id': 'req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.943575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d18832a36424d7bac50a8de07592680', 'request_id': 'req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.955725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d18832a36424d7bac50a8de07592680', 'request_id': 'req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:50.999212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] The token cache is being invalidate because project 5d18832a36424d7bac50a8de07592680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:51.000007 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.000860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.006225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1088/2171] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:50 2021] DELETE /identity/v3/projects/5d18832a36424d7bac50a8de07592680 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:51.010908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:51.012738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:51.160955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e311f-cb73-430c-ac26-18288a1a9efe admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:51.318287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:51.323636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:51.324038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:51.324475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] PATH_INFO: `/v3/users/4bba76f8710342c09a29b0c4d238bd22` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:51.328004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bba76f8710342c09a29b0c4d238bd22)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:51.332281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:51.437423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bba76f8710342c09a29b0c4d238bd22'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.438587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bba76f8710342c09a29b0c4d238bd22'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.439649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bba76f8710342c09a29b0c4d238bd22'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.457501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bba76f8710342c09a29b0c4d238bd22'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.497854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bba76f8710342c09a29b0c4d238bd22'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:51.529094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1084/2172] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:51 2021] DELETE /identity/v3/users/4bba76f8710342c09a29b0c4d238bd22 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:51.931964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:51.935160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:51.962108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5c5cb-1af3-4bcd-a587-ac0ed2ebc1ab admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:52.067520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:52.069566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:52.069985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:52.070710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] PATH_INFO: `/v3/projects/f26ee4e302c4404290f377cd2a961ee4` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:52.073834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26ee4e302c4404290f377cd2a961ee4)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:52.077988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:52.209625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:52.212038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:52.230642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26ee4e302c4404290f377cd2a961ee4', 'request_id': 'req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.234485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcae55f-f427-46b7-825c-1e1ed3e4cdfc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:52.252612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26ee4e302c4404290f377cd2a961ee4', 'request_id': 'req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.267186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26ee4e302c4404290f377cd2a961ee4', 'request_id': 'req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.297320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] The token cache is being invalidate because project f26ee4e302c4404290f377cd2a961ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:52.298074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.299912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.306248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1089/2173] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:51 2021] DELETE /identity/v3/projects/f26ee4e302c4404290f377cd2a961ee4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:52.312810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:52.316284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:52.421036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:52.425945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:52.425945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:52.428028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] PATH_INFO: `/v3/projects/8b60e47ba75a45769d79837628dfdae0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:52.434018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b60e47ba75a45769d79837628dfdae0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:52.439818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:52.467439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd17f4-24f9-4492-ae5d-ba059c5e43ab admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:52.477626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:52.483030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:52.484635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:52.485880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] PATH_INFO: `/v3/users/3c45bcf699fa420195c57b210d1e57b5` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:52.491432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c45bcf699fa420195c57b210d1e57b5)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:52.494800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:52.641678 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b60e47ba75a45769d79837628dfdae0', 'request_id': 'req-90243992-1854-4471-8b2d-90c5261f915e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.649934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c45bcf699fa420195c57b210d1e57b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.651587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c45bcf699fa420195c57b210d1e57b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.653194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c45bcf699fa420195c57b210d1e57b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.657216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b60e47ba75a45769d79837628dfdae0', 'request_id': 'req-90243992-1854-4471-8b2d-90c5261f915e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.666536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c45bcf699fa420195c57b210d1e57b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.670989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b60e47ba75a45769d79837628dfdae0', 'request_id': 'req-90243992-1854-4471-8b2d-90c5261f915e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.689027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9afbd148-faf3-4dd7-bff2-07d2ea6200cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c45bcf699fa420195c57b210d1e57b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.703586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] The token cache is being invalidate because project 8b60e47ba75a45769d79837628dfdae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:52.704275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.705972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.709192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1085/2174] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:52 2021] DELETE /identity/v3/projects/8b60e47ba75a45769d79837628dfdae0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:52.710647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:52.712915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:52.714256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1090/2175] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:52 2021] DELETE /identity/v3/users/3c45bcf699fa420195c57b210d1e57b5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:52.717686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4684e4-76e5-479a-ab41-e05490270ce9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:52.718234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4684e4-76e5-479a-ab41-e05490270ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:52.718680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4684e4-76e5-479a-ab41-e05490270ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:52.798190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-df4684e4-76e5-479a-ab41-e05490270ce9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:52.805191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-df4684e4-76e5-479a-ab41-e05490270ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:52.815505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90243992-1854-4471-8b2d-90c5261f915e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:52.885572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:52.886601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:52.886958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:52.887311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] PATH_INFO: `/v3/users/95faba77a19d43a5b7d57434729529b9` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:52.889194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95faba77a19d43a5b7d57434729529b9)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:52.891365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:52.975857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95faba77a19d43a5b7d57434729529b9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.976606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95faba77a19d43a5b7d57434729529b9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.976984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95faba77a19d43a5b7d57434729529b9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:52.990408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95faba77a19d43a5b7d57434729529b9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.016785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1091/2176] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:53.017559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b2aa447e-f19d-4491-9015-eb9b78b40d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95faba77a19d43a5b7d57434729529b9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.029720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.030073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.030307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.034067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1086/2177] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:52 2021] DELETE /identity/v3/users/95faba77a19d43a5b7d57434729529b9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:53.039797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.040125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.040400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.056215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:53.058148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.075952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:53.078942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.162149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1092/2178] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:53.166745 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.179458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4f13-10d3-48d7-a717-344a334cd3fd None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.186309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.187327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.187763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.188185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.189134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:53.189609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.193602 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1087/2179] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:53.194943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.202765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.204929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.231012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1093/2180] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:55:53.232846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.235109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.252309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813de89-f8d2-429f-87d4-13b7f69fc42d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.258789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.259835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.260170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.260500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] PATH_INFO: `/v3/projects/396a157f2b7d4e6eb518a113c2f73092` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.261919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396a157f2b7d4e6eb518a113c2f73092)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.264596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.308672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed308204-79cd-42b4-9a97-84cd65b082cb None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.313571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.314263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.314541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.314811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.326407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.327929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.332973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396a157f2b7d4e6eb518a113c2f73092', 'request_id': 'req-3f06f2d4-00df-450d-b804-e700d0316658'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.340155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1088/2181] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:53.341346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.345136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396a157f2b7d4e6eb518a113c2f73092', 'request_id': 'req-3f06f2d4-00df-450d-b804-e700d0316658'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.354452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5c576-151d-4235-9021-900fa552e42e service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.355462 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396a157f2b7d4e6eb518a113c2f73092', 'request_id': 'req-3f06f2d4-00df-450d-b804-e700d0316658'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.376293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] The token cache is being invalidate because project 396a157f2b7d4e6eb518a113c2f73092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:53.376799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.377971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3f06f2d4-00df-450d-b804-e700d0316658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:53.389980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1094/2182] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:53 2021] DELETE /identity/v3/projects/396a157f2b7d4e6eb518a113c2f73092 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:53.392224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e313-484e-4927-ba7e-640ba7a88048 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.392439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e313-484e-4927-ba7e-640ba7a88048 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.392619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e313-484e-4927-ba7e-640ba7a88048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.425206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-58b5e313-484e-4927-ba7e-640ba7a88048 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:53.427268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-58b5e313-484e-4927-ba7e-640ba7a88048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.458720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.459910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.460526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.461112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.462555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.466051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.518679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1089/2183] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:53.523262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.525641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.539868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1095/2184] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:53.551138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.551710 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.552297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.587060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:53.589192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:53.640383 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66029-efb1-43a3-a6dd-0a1f13f4767f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.659110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.660531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.661120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.661912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.663402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.669623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.701515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1096/2185] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:53.706492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.722555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1090/2186] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:53.723578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.726879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1a2fb-4f33-4b8b-8376-53ddaba13033 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.736660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192f52f-2b93-49bf-87ec-4c102970d22f admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.738342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.739804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.740395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.740908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.744026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:53.744636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.745270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.745965 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.746289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.746579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.747594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.748215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.749643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.764523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1091/2187] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:53 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:53.779000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.785622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1097/2188] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:55:53.789159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.804919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe017f0-71ed-4550-9b2f-4cda4d015015 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.807065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868961b0-6741-418d-a973-8816a80804a2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.810716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.811405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.812217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.812217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.812689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.816593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.819651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.820860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.821407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.821942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.823220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:53.826332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:53.842349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1092/2189] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:53 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:53.847450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.860199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e8dd-fb8c-49c2-b45e-13a2d75c92c2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.861337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1098/2190] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:53.867136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:53.956409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:53.959365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:53.960263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:53.961008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] PATH_INFO: `/v3/projects/bd7660cadc504d46813e6de7127d8a31/users/a03ccd5612d14d61baf6ab2f90760b38/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:53.990496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d039f8-eb77-418f-a440-ac5e070e5cf0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:53.992848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7660cadc504d46813e6de7127d8a31, user_id=a03ccd5612d14d61baf6ab2f90760b38, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.000465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.000636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4838-343d-4b26-84f2-f4eddd18e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.012171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4838-343d-4b26-84f2-f4eddd18e070 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.013071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4838-343d-4b26-84f2-f4eddd18e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.013911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4838-343d-4b26-84f2-f4eddd18e070 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.020070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1093/2191] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:53 2021] PUT /identity/v3/projects/bd7660cadc504d46813e6de7127d8a31/users/a03ccd5612d14d61baf6ab2f90760b38/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:54.021048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.022715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed4838-343d-4b26-84f2-f4eddd18e070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.024935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed4838-343d-4b26-84f2-f4eddd18e070 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.037327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.065078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1099/2192] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:53 2021] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:55:54.065078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.065078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.065078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.096968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] MFA Rules not processed for user `a03ccd5612d14d61baf6ab2f90760b38`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:54.099163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.152433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd2b4-2102-44fb-b380-4be8066070a8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:54.163046 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.164538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.165044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.165530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] PATH_INFO: `/v3/projects/7320b81930504951bbfd7828d8396af3` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.170497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7320b81930504951bbfd7828d8396af3)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.174254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.217551 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1100/2193] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:54 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:54.219133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.238981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb413d-5b27-4fc0-b528-c0ac7064d1a3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:54.264667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7320b81930504951bbfd7828d8396af3', 'request_id': 'req-dc927f16-e84e-4cef-be76-2873b1904c3c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.279577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7320b81930504951bbfd7828d8396af3', 'request_id': 'req-dc927f16-e84e-4cef-be76-2873b1904c3c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.292121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7320b81930504951bbfd7828d8396af3', 'request_id': 'req-dc927f16-e84e-4cef-be76-2873b1904c3c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.312301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] The token cache is being invalidate because project 7320b81930504951bbfd7828d8396af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:54.313331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.314245 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.321266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1094/2194] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:54 2021] DELETE /identity/v3/projects/7320b81930504951bbfd7828d8396af3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:54.321266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.321266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.328265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.329502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.329896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.330205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.331049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.332968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.354249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1101/2195] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:54 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:54.354249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.360348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.377448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aacdb-8e3e-4dc7-802f-a915f146f84b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:54.384742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.385740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.386106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.386490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] PATH_INFO: `/v3/users/cfd025bd75a949a3a4c2f4e26bb9f93d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.388254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd025bd75a949a3a4c2f4e26bb9f93d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.391704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.435889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc927f16-e84e-4cef-be76-2873b1904c3c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:54.441653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.442586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.443084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.443519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.445969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.465998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd025bd75a949a3a4c2f4e26bb9f93d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.467471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd025bd75a949a3a4c2f4e26bb9f93d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.468490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd025bd75a949a3a4c2f4e26bb9f93d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.481353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd025bd75a949a3a4c2f4e26bb9f93d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.503010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd025bd75a949a3a4c2f4e26bb9f93d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:54.515655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.517029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.526292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1102/2196] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:54 2021] DELETE /identity/v3/users/cfd025bd75a949a3a4c2f4e26bb9f93d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:54.527400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1095/2197] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:54 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:54.527859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.530888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.672994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a564b-755c-42c0-a193-441883e589fd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:54.678846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b49832-e5cb-4ca3-9f4f-ba556f36d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.679570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49832-e5cb-4ca3-9f4f-ba556f36d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.679858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49832-e5cb-4ca3-9f4f-ba556f36d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.680131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49832-e5cb-4ca3-9f4f-ba556f36d9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.680912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b49832-e5cb-4ca3-9f4f-ba556f36d9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.682638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b49832-e5cb-4ca3-9f4f-ba556f36d9b3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.707569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1103/2198] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:54 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:54.709484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.712422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.743977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a91e-9417-44f5-aacc-d4235ce219d8 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:54.751883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:54.753216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.753805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.754708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] PATH_INFO: `/v3/projects/ed63c48f99fc4f7ca3b3f5e099fabfea/users/8a5ce0604ab540009e3e297501c4d2ad/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.795900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed63c48f99fc4f7ca3b3f5e099fabfea, user_id=8a5ce0604ab540009e3e297501c4d2ad, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:54.801538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:54.837399 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1096/2199] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:54 2021] PUT /identity/v3/projects/ed63c48f99fc4f7ca3b3f5e099fabfea/users/8a5ce0604ab540009e3e297501c4d2ad/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:54.859571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f427-51cd-489d-b748-7181707f470a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:54.870582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f427-51cd-489d-b748-7181707f470a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:54.870582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f427-51cd-489d-b748-7181707f470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:54.936441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5984f427-51cd-489d-b748-7181707f470a None None] MFA Rules not processed for user `8a5ce0604ab540009e3e297501c4d2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:54.938350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5984f427-51cd-489d-b748-7181707f470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:54.986977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:54.990657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:55.063732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1104/2200] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:55.081369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f427-51cd-489d-b748-7181707f470a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:55.084519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5984f427-51cd-489d-b748-7181707f470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:55.163202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1cb02-0fa8-409a-b25e-fc50bbaab183 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:55.187063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:55.187998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:55.191480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:55.191814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] PATH_INFO: `/v3/projects/e81f5283590943c1a876f5efb9390cbf` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:55.193945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81f5283590943c1a876f5efb9390cbf)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:55.196011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:55.206326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f427-51cd-489d-b748-7181707f470a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:55.219026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:55.222834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:55.223318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:55.224811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:55.235827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:55.239309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:55.264415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1105/2201] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:55 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:55:55.395908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81f5283590943c1a876f5efb9390cbf', 'request_id': 'req-85c02748-6d11-436b-b05b-3f9fd69d531d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.415805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81f5283590943c1a876f5efb9390cbf', 'request_id': 'req-85c02748-6d11-436b-b05b-3f9fd69d531d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.435230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81f5283590943c1a876f5efb9390cbf', 'request_id': 'req-85c02748-6d11-436b-b05b-3f9fd69d531d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.501821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] The token cache is being invalidate because project e81f5283590943c1a876f5efb9390cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:55.506273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.507744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.515306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1097/2202] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:54 2021] DELETE /identity/v3/projects/e81f5283590943c1a876f5efb9390cbf => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:55.517246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:55.551196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0499cb-ea59-4877-a6e1-5a62204e3ac9 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:55.700442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:55.701850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:55.702420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:55.702918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] PATH_INFO: `/v3/users/ae19c8d02cc4469ca67d36dd39390751` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:55.705316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae19c8d02cc4469ca67d36dd39390751)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:55.708450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:55.825153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae19c8d02cc4469ca67d36dd39390751'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.826940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae19c8d02cc4469ca67d36dd39390751'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.830852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae19c8d02cc4469ca67d36dd39390751'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.845608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae19c8d02cc4469ca67d36dd39390751'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.917745 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-613e6c83-4f4a-41a1-a6ea-562b4eb5f667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae19c8d02cc4469ca67d36dd39390751'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:55.970059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1106/2203] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:55:55 2021] DELETE /identity/v3/users/ae19c8d02cc4469ca67d36dd39390751 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:56.474061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:56.476235 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:56.504526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02748-6d11-436b-b05b-3f9fd69d531d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:56.632589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:56.633712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:56.634006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:56.634317 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] PATH_INFO: `/v3/projects/2a1951a62c5443e7ab85faf3731bf3dd` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:56.635778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1951a62c5443e7ab85faf3731bf3dd)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:56.637874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:56.698363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1951a62c5443e7ab85faf3731bf3dd', 'request_id': 'req-d3da2156-d07c-4ffd-9793-e537dba02418'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:56.710705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1951a62c5443e7ab85faf3731bf3dd', 'request_id': 'req-d3da2156-d07c-4ffd-9793-e537dba02418'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:56.721832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1951a62c5443e7ab85faf3731bf3dd', 'request_id': 'req-d3da2156-d07c-4ffd-9793-e537dba02418'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:56.741333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] The token cache is being invalidate because project 2a1951a62c5443e7ab85faf3731bf3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:55:56.741625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:56.742352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d3da2156-d07c-4ffd-9793-e537dba02418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:55:56.744225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1098/2204] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:55:56 2021] DELETE /identity/v3/projects/2a1951a62c5443e7ab85faf3731bf3dd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:55:56.752098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:56.752726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:56.752726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:56.773879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:56.776147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:56.851261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1107/2205] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:55:56.860992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:56.861502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:56.862012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:56.890351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:56.891741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:56.903912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1099/2206] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:56.907435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:56.922612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cced3-d466-456b-aeb1-5c45750a96d0 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:56.930990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:56.932435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:56.932926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:56.933450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:56.935000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:55:56.935576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:56.938813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:56.957613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1108/2207] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:55:56.963459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:56.975151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e0244-58e8-45b8-aacf-27dc854ad9e6 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:56.980427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:56.981137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:56.981425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:56.981735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:56.982523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:56.984435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:57.025196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1100/2208] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:55:56 2021] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:57.029443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:57.049085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975215d-9a0a-4ff2-8f04-348fa901f55d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:57.121330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:57.121914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:57.123129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:57.123406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:57.124141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:57.126109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:57.149273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1109/2209] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:55:57 2021] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:55:57.153600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:57.165366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4408f-b471-46a9-b43c-d8260a050a6c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:57.171092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:57.171794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:57.172073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:57.172344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:57.173114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:57.174793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:57.193735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1101/2210] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:57 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:57.198445 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:57.211077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fa02-32ea-4c54-ad20-5fa5aaef02f1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:57.217064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da21f2f-72f6-40c8-8b61-5eee1999b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:57.217764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da21f2f-72f6-40c8-8b61-5eee1999b3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:57.218059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da21f2f-72f6-40c8-8b61-5eee1999b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:57.218372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da21f2f-72f6-40c8-8b61-5eee1999b3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:57.219131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da21f2f-72f6-40c8-8b61-5eee1999b3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:57.220804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da21f2f-72f6-40c8-8b61-5eee1999b3c4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:57.232199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1110/2211] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:55:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:55:57.237974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:57.248974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e328d5-ddc2-434e-bf50-0d68bc16a5fa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:57.256637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:57.258338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:57.258893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:57.259397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] PATH_INFO: `/v3/projects/2725ba365efe479184044631f591e663/users/50be32c542ac44929b7d2149d41170f8/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:57.279012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2725ba365efe479184044631f591e663, user_id=50be32c542ac44929b7d2149d41170f8, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:57.281743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:57.300047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1102/2212] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:55:57 2021] PUT /identity/v3/projects/2725ba365efe479184044631f591e663/users/50be32c542ac44929b7d2149d41170f8/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:55:57.311168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:57.311451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:57.311725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:57.341414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] MFA Rules not processed for user `50be32c542ac44929b7d2149d41170f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:55:57.346183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:57.416126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1111/2213] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:55:57 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:55:57.427092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:55:57.428869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:55:57.488969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93262202-aab4-4424-841b-12be0e550409 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:55:57.492934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7564f71-d7ca-492c-84c6-0db93ecb730e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:55:57.493589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7564f71-d7ca-492c-84c6-0db93ecb730e service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:55:57.493863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7564f71-d7ca-492c-84c6-0db93ecb730e service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:55:57.494150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7564f71-d7ca-492c-84c6-0db93ecb730e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:55:57.504176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7564f71-d7ca-492c-84c6-0db93ecb730e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:55:57.505634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7564f71-d7ca-492c-84c6-0db93ecb730e service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:55:57.515798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1103/2214] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:55:57 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:03.353360 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:03.355747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:03.465120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b8ee8-186b-4268-b542-dfee5d127093 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:03.480537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:03.482407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:03.483201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:03.483917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] PATH_INFO: `/v3/users/8a5ce0604ab540009e3e297501c4d2ad` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:03.487112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5ce0604ab540009e3e297501c4d2ad)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:03.491401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:03.562346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5ce0604ab540009e3e297501c4d2ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:03.563090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5ce0604ab540009e3e297501c4d2ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:03.563721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5ce0604ab540009e3e297501c4d2ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:03.573189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5ce0604ab540009e3e297501c4d2ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:03.588129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5ce0604ab540009e3e297501c4d2ad'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:03.603856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1112/2215] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:03 2021] DELETE /identity/v3/users/8a5ce0604ab540009e3e297501c4d2ad => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:03.610304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:03.610949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:03.611477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:03.639106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:03.640770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:03.725514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1104/2216] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:03.739729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:03.740585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:03.836535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86388-c670-43d1-b93a-a6b5f6f3561b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:03.842599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e8d99-58b1-4ba8-9ddc-9389678e8ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:03.843177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e8d99-58b1-4ba8-9ddc-9389678e8ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:03.843511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e8d99-58b1-4ba8-9ddc-9389678e8ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:03.843962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e8d99-58b1-4ba8-9ddc-9389678e8ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:03.855163 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e8d99-58b1-4ba8-9ddc-9389678e8ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:03.857049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e8d99-58b1-4ba8-9ddc-9389678e8ca3 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:03.871117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1113/2217] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:03.927038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:03.928963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:03.952033 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d20616-7418-4f12-a28d-08f689a7b8fa None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:03.961141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:03.962621 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:03.963378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:03.963703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] PATH_INFO: `/v3/users/f1e276220b324164b1821461efbd8869` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:03.967300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e276220b324164b1821461efbd8869)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:03.969880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:04.061306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e276220b324164b1821461efbd8869'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.062233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e276220b324164b1821461efbd8869'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.063312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e276220b324164b1821461efbd8869'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.074450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e276220b324164b1821461efbd8869'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.106001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e276220b324164b1821461efbd8869'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.139054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1105/2218] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:03 2021] DELETE /identity/v3/users/f1e276220b324164b1821461efbd8869 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:04.146737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.147132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.147656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.199643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:04.202650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:04.334248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1114/2219] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:04.347724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:04.349844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:04.394211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:04.396590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:04.433177 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66713e-ad31-439f-b724-546ec85daf4b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:04.448913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:04.450620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.451091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.451640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] PATH_INFO: `/v3/projects/ed63c48f99fc4f7ca3b3f5e099fabfea` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.454642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed63c48f99fc4f7ca3b3f5e099fabfea)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:04.457995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:04.485927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdf372-7984-4313-a3c9-1f82097a5a7b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:04.494933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a695c-c2cb-4a11-8efc-adb07bfbc12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:04.495690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a695c-c2cb-4a11-8efc-adb07bfbc12d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.496254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a695c-c2cb-4a11-8efc-adb07bfbc12d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.496824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a695c-c2cb-4a11-8efc-adb07bfbc12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.527361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a695c-c2cb-4a11-8efc-adb07bfbc12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:04.536075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a695c-c2cb-4a11-8efc-adb07bfbc12d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:04.590041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1106/2220] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:56:04.620773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed63c48f99fc4f7ca3b3f5e099fabfea', 'request_id': 'req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.640988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed63c48f99fc4f7ca3b3f5e099fabfea', 'request_id': 'req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.657076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed63c48f99fc4f7ca3b3f5e099fabfea', 'request_id': 'req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.680131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] The token cache is being invalidate because project ed63c48f99fc4f7ca3b3f5e099fabfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:04.680728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.682273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:04.691904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1115/2221] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:04 2021] DELETE /identity/v3/projects/ed63c48f99fc4f7ca3b3f5e099fabfea => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:56:04.695156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c386-11fd-4803-b77a-14f6fe7e266f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.695754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c386-11fd-4803-b77a-14f6fe7e266f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.696134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c386-11fd-4803-b77a-14f6fe7e266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.732477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e018c386-11fd-4803-b77a-14f6fe7e266f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:04.734612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e018c386-11fd-4803-b77a-14f6fe7e266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:04.773869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:04.774942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:04.857730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1107/2222] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:04.861037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.861415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.861701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.891231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:04.892468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:04.905524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1108/2223] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:04.907464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:04.918633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f537b-71c3-4539-9514-5f9b06ecff54 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:04.924742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0927cc-6f12-4b9e-acc3-179c4c75d7b5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:04.925961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:04.926599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.927195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.927777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.928819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:56:04.929843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:04.931547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:04.946693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:04.948255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.948791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.949293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] PATH_INFO: `/v3/users/f27ee9d973e54af2a5173bdf89fc34a6` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.949467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1109/2224] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:56:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:56:04.952357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27ee9d973e54af2a5173bdf89fc34a6)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:04.954063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:04.956755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:04.968038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d4863-2a67-4e52-86a8-1845f5ff676e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:04.973312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:04.974063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:04.974441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:04.974917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:04.978200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:04.983107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.019523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1110/2225] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:04 2021] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:56:05.023865 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.042104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27ee9d973e54af2a5173bdf89fc34a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.043279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27ee9d973e54af2a5173bdf89fc34a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.044365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27ee9d973e54af2a5173bdf89fc34a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.053953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27ee9d973e54af2a5173bdf89fc34a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.081284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2ac9377d-c3cb-4f92-805e-ba67be580691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27ee9d973e54af2a5173bdf89fc34a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.100030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753e4ba-6d4b-4d6c-a022-629de8ed6cbd admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.104149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1116/2226] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:04 2021] DELETE /identity/v3/users/f27ee9d973e54af2a5173bdf89fc34a6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:56:05.107178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.107934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.108481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.108761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.109497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.111496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.111624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.112216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.112793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.144915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1111/2227] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:05 2021] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:56:05.149853 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.153747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:05.153747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.154520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.170138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06742f8f-0ce4-4a26-bd14-4edec59792de admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.225676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1117/2228] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:05.226596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.227902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.241384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61795403-3c22-4da0-92a2-23a963afcdaf None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.246647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.247735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.248244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.248600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] PATH_INFO: `/v3/projects/fc8e5804dc2f4540ae83921e11861afb` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.250141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8e5804dc2f4540ae83921e11861afb)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.252263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.254891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.255576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.255862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.256141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.256945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.258632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.274751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1112/2229] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:05 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:56:05.276421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.279413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.341759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8e5804dc2f4540ae83921e11861afb', 'request_id': 'req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.356091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8e5804dc2f4540ae83921e11861afb', 'request_id': 'req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.368592 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8e5804dc2f4540ae83921e11861afb', 'request_id': 'req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.380019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a89425-7aea-43b1-858a-63ac8dfacbaf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.385222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] The token cache is being invalidate because project fc8e5804dc2f4540ae83921e11861afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:05.385662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.386811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.389220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1118/2230] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:05 2021] DELETE /identity/v3/projects/fc8e5804dc2f4540ae83921e11861afb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:05.390314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.391967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.453985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.454866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.455144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.455419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.457527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.476413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa09c6-647e-4d36-9ba5-419f9d9e562c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.482470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.483506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.484027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.484469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.485603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.487455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.501534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1119/2231] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:05 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:05.508012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.518526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.547216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8769-1207-4241-8819-b334785cfa5e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.558509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.559838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.560362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.560877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] PATH_INFO: `/v3/users/7ea4e0f210aa43b3a1816911c7df5f8f` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.563165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea4e0f210aa43b3a1816911c7df5f8f)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.565780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.602352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.604538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.620239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1113/2232] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:05.621752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.641257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c8654-fdab-457b-a488-36f9b221ab4d service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:05.647456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:05.648492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.648772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.649051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] PATH_INFO: `/v3/projects/c105f319bb0c48cb97b3596b649449fa/users/a01d78ca634846c085245525cf4f0a8c/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.656263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea4e0f210aa43b3a1816911c7df5f8f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.657417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea4e0f210aa43b3a1816911c7df5f8f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.658945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea4e0f210aa43b3a1816911c7df5f8f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.669902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c105f319bb0c48cb97b3596b649449fa, user_id=a01d78ca634846c085245525cf4f0a8c, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:05.673672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:05.675759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea4e0f210aa43b3a1816911c7df5f8f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.706316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1114/2233] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:05 2021] PUT /identity/v3/projects/c105f319bb0c48cb97b3596b649449fa/users/a01d78ca634846c085245525cf4f0a8c/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:05.706316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:05.706316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.718035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-9d2092d9-81fa-4158-81d8-6d9343ae17f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea4e0f210aa43b3a1816911c7df5f8f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:05.743535 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1120/2234] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:05 2021] DELETE /identity/v3/users/7ea4e0f210aa43b3a1816911c7df5f8f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:05.746455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:05.747288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:05.748216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:05.803370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] MFA Rules not processed for user `a01d78ca634846c085245525cf4f0a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:05.805625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:05.808268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988ca9f-1a05-4fd0-8e07-5d7c20675b48 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:06.003366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1121/2235] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:05 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:06.024625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:06.025530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.025892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.026220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] PATH_INFO: `/v3/users/a03ccd5612d14d61baf6ab2f90760b38` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.028707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:06.030455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.031816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03ccd5612d14d61baf6ab2f90760b38)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:06.034957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:06.191991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07b48d-aa57-45ae-a8f3-0ee91ea83d10 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:06.210478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03ccd5612d14d61baf6ab2f90760b38'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.211352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:06.213459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.214071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03ccd5612d14d61baf6ab2f90760b38'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.214619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.215326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.217299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03ccd5612d14d61baf6ab2f90760b38'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.220514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.241555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03ccd5612d14d61baf6ab2f90760b38'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.253210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:06.257264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:06.268648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-76bb5c1d-cda0-45f3-bb65-4d22f612aef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03ccd5612d14d61baf6ab2f90760b38'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.297724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1115/2236] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:05 2021] DELETE /identity/v3/users/a03ccd5612d14d61baf6ab2f90760b38 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:06.304274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.304687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.304972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1122/2237] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:06 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:56:06.305142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.343244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:06.345416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.464486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:06.470111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.474959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1116/2238] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:06.497351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:06.500606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.517621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6f553-8835-42f2-b933-e91f0c3625f6 service glance] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:06.524328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:06.525576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.526048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.526568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] PATH_INFO: `/v3/projects/2977596813784681a72697e496f0921c` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.528913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2977596813784681a72697e496f0921c)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:06.532506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:06.657633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e96e1-11fe-409f-878f-3fe491c608f4 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:06.662748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2977596813784681a72697e496f0921c', 'request_id': 'req-d65c9830-df85-4e3c-ae31-358e8ea5e55e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.688575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2977596813784681a72697e496f0921c', 'request_id': 'req-d65c9830-df85-4e3c-ae31-358e8ea5e55e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.702055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2977596813784681a72697e496f0921c', 'request_id': 'req-d65c9830-df85-4e3c-ae31-358e8ea5e55e'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.723649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] The token cache is being invalidate because project 2977596813784681a72697e496f0921c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:06.724375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.725970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:06.729314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1123/2239] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:06 2021] DELETE /identity/v3/projects/2977596813784681a72697e496f0921c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:06.731112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:06.733801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.749656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:06.750510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.750699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.751441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.753674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.851461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:06.853384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c42cc-20cf-44aa-b7d1-3b4adcd828a3 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:06.857101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c9830-df85-4e3c-ae31-358e8ea5e55e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:06.875268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:06.875268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.875268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.875268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] PATH_INFO: `/v3/projects/75a2ae36ab5c4513b0e9250ea74b32ff` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.875634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1117/2240] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:56:06.883117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9eb1f-5a45-4605-a67f-9752f8158572 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.883665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9eb1f-5a45-4605-a67f-9752f8158572 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.884323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9eb1f-5a45-4605-a67f-9752f8158572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.885858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a2ae36ab5c4513b0e9250ea74b32ff)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:06.889252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:06.912048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fcb9eb1f-5a45-4605-a67f-9752f8158572 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:06.914009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fcb9eb1f-5a45-4605-a67f-9752f8158572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:06.925390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1118/2241] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:06.934548 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:06.934819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:06.935107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:06.980555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:06.980555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:07.017171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a2ae36ab5c4513b0e9250ea74b32ff', 'request_id': 'req-1c2d0045-3d58-4cb8-b077-6be17feabaf2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:07.039778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a2ae36ab5c4513b0e9250ea74b32ff', 'request_id': 'req-1c2d0045-3d58-4cb8-b077-6be17feabaf2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:07.066518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a2ae36ab5c4513b0e9250ea74b32ff', 'request_id': 'req-1c2d0045-3d58-4cb8-b077-6be17feabaf2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:07.092345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] The token cache is being invalidate because project 75a2ae36ab5c4513b0e9250ea74b32ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:07.093060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:07.094246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1c2d0045-3d58-4cb8-b077-6be17feabaf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:07.096930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1124/2242] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:06 2021] DELETE /identity/v3/projects/75a2ae36ab5c4513b0e9250ea74b32ff => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:07.104791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b0de-a505-4847-8ec9-10ae7c0c685b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.105282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b0de-a505-4847-8ec9-10ae7c0c685b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.105707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b0de-a505-4847-8ec9-10ae7c0c685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.132242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f749b0de-a505-4847-8ec9-10ae7c0c685b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:07.133626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f749b0de-a505-4847-8ec9-10ae7c0c685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:07.197272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1119/2243] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:07.204566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.234774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1125/2244] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:07.237527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.238906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.239129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a974d7-686c-42ba-b52f-07b047406927 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.239575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.255992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.258429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.259669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.261219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.271673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:56:07.272378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.275797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.288861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:07.290193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:07.318203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1126/2245] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:07.319174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.322946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1120/2246] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:56:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:56:07.331226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.338433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56d9e2-d8db-4725-b0cb-ad4018cfebe9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.357917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.358646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.358932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.359214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.359993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:56:07.360307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.374022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.395388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154afbdc-ece2-448b-a1d6-4acaa2e28372 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.402314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1127/2247] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:56:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:56:07.410334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.439572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381056-3e52-46be-8cee-c9c816ac6cc4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.440114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.441176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.441719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.442205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.450096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.455529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.456215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.456498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.456772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.457134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.457482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.461583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.524372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1128/2248] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:07 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:07.525930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.541384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1121/2249] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:07 2021] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:07.546841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.671729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb968-ea5f-41bb-89e8-435902813a66 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.689906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.691758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.692040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.692314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.693042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.699238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.749788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de68fb-a57e-4349-940f-d7bcbe872328 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.761009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1122/2250] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:07 2021] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:07.762115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.774968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.775663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.775947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.776926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.776926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.780588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:07.787455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.815222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4534312-bc4a-4d6b-9e41-f3b8dfa3858c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.832510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.833569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.833857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.834129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] PATH_INFO: `/v3/projects/bd7660cadc504d46813e6de7127d8a31` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.839240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7660cadc504d46813e6de7127d8a31)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.841833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.849845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1129/2251] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:07 2021] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:07.849845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.885566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20972aa-e7ba-4aab-8357-95bef263dd04 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.904093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.904803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.905090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.905372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.906151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.908289 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.936473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1130/2252] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:07 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:07.936473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:07.943100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d5ae3-a2c4-4add-9165-673ee5e4e6e7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:07.960901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:07.961815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:07.962235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:07.962944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:07.964056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:07.966296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:07.998152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7660cadc504d46813e6de7127d8a31', 'request_id': 'req-a98586f9-841e-4056-8a20-9178a2bc3e02'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:08.000465 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1131/2253] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:07 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:08.003281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.018925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7660cadc504d46813e6de7127d8a31', 'request_id': 'req-a98586f9-841e-4056-8a20-9178a2bc3e02'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:08.035580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cf1c6-1402-4a86-abab-5812691db02f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:08.037754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7660cadc504d46813e6de7127d8a31', 'request_id': 'req-a98586f9-841e-4056-8a20-9178a2bc3e02'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:08.054790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] The token cache is being invalidate because project bd7660cadc504d46813e6de7127d8a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:08.055506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:08.057028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:08.059581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1123/2254] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:07 2021] DELETE /identity/v3/projects/bd7660cadc504d46813e6de7127d8a31 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:08.061023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.080334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:08.285098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98586f9-841e-4056-8a20-9178a2bc3e02 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:08.295497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:08.296305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.296660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.296951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.308594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:08.311097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:08.327997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1124/2255] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:08 2021] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:08.334388 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.338907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:08.342038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.342414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.342648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.344979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:08.347639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd0e05-5672-4dd3-a289-8b160770fcc5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:08.348353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:08.354356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7eaf2-1542-4fc4-8056-55314e0ba1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:08.355529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7eaf2-1542-4fc4-8056-55314e0ba1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.356083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7eaf2-1542-4fc4-8056-55314e0ba1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.357270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7eaf2-1542-4fc4-8056-55314e0ba1e8 admin admin] PATH_INFO: `/v3/projects/20ca518d4ee447b3b7ad79544ec13e0d/users/d9cdb673ba1f417b8cc0734ad38ed57f/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.366521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1132/2256] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:08 2021] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:08.372174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.375174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:08.383024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7eaf2-1542-4fc4-8056-55314e0ba1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ca518d4ee447b3b7ad79544ec13e0d, user_id=d9cdb673ba1f417b8cc0734ad38ed57f, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:08.385934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7eaf2-1542-4fc4-8056-55314e0ba1e8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:08.398074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d11efe-0ed9-4ba5-964e-34eb6709de83 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:08.404321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1125/2257] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:08 2021] PUT /identity/v3/projects/20ca518d4ee447b3b7ad79544ec13e0d/users/d9cdb673ba1f417b8cc0734ad38ed57f/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:08.411250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.411572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.411885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.432565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:08.435154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:08.476831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cb24d-dfe8-4edb-a1b8-6bb9226dab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:08.478586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb24d-dfe8-4edb-a1b8-6bb9226dab9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.479129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb24d-dfe8-4edb-a1b8-6bb9226dab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.479573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cb24d-dfe8-4edb-a1b8-6bb9226dab9b admin admin] PATH_INFO: `/v3/projects/ef4dd593cebd49648530c28b2f3f18e0/users/a17492adde6a4a0ab3d6efc9315c56dd/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.511853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cb24d-dfe8-4edb-a1b8-6bb9226dab9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4dd593cebd49648530c28b2f3f18e0, user_id=a17492adde6a4a0ab3d6efc9315c56dd, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:08.517396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cb24d-dfe8-4edb-a1b8-6bb9226dab9b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:08.540396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1133/2258] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:08 2021] PUT /identity/v3/projects/ef4dd593cebd49648530c28b2f3f18e0/users/a17492adde6a4a0ab3d6efc9315c56dd/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:08.546891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1126/2259] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:08.552107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.552572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.554479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.569729 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.571392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:08.615353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] MFA Rules not processed for user `a17492adde6a4a0ab3d6efc9315c56dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:08.617505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:08.701167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c366d6-1a4e-4d66-9854-f71c05d6d689 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:08.750150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1134/2260] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:08 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:08.757986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.792134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:08.793015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.793015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.793314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.855025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b25cf-d1c1-413a-aa80-04694abe35ca None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:08.865475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:08.866777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:08.867204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:08.867647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:08.868632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:08.871506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:08.914469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:08.916430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1135/2261] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:08 2021] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:56:08.919256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:08.921909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:08.941274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1127/2262] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:09.028361 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2d65-7a8e-423f-a0d2-4981f9326714 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.045447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.046598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.047330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.047771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.049108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.053518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.089585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1136/2263] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:08 2021] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:56:09.092469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:09.110688 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4784c-552a-4ad8-a589-32d48282a22d service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.116263 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.117112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.117588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.117857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.118918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.120958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.143559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1128/2264] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:09 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:09.145435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:09.164358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746cf30-911f-4db2-82e3-339964d378cb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.173324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.175357 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.175846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.176344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] PATH_INFO: `/v3/projects/8b395e4be74b4b2a94dc9dc71a065789/users/f6e5231fa08844b8b6744fd49e9fce9a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.206125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b395e4be74b4b2a94dc9dc71a065789, user_id=f6e5231fa08844b8b6744fd49e9fce9a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.212654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.263160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1137/2265] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:09 2021] PUT /identity/v3/projects/8b395e4be74b4b2a94dc9dc71a065789/users/f6e5231fa08844b8b6744fd49e9fce9a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:09.268854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:09.283829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b36bcb-66c2-4950-9b1d-44384c20fff7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.394619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26c23-617d-4b02-adec-6d6de1aae300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.395568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26c23-617d-4b02-adec-6d6de1aae300 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.396005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26c23-617d-4b02-adec-6d6de1aae300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.396410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26c23-617d-4b02-adec-6d6de1aae300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.397351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26c23-617d-4b02-adec-6d6de1aae300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.399286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26c23-617d-4b02-adec-6d6de1aae300 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.413662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1129/2266] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:09 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:56:09.419404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:09.432614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d28fcf-c1ab-4484-975d-9df5369ddb49 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.437796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.438765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.439036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.439383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] PATH_INFO: `/v3/projects/8b395e4be74b4b2a94dc9dc71a065789/users/f6e5231fa08844b8b6744fd49e9fce9a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.441643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b395e4be74b4b2a94dc9dc71a065789, user_id=f6e5231fa08844b8b6744fd49e9fce9a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.444399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.456625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1138/2267] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:09 2021] PUT /identity/v3/projects/8b395e4be74b4b2a94dc9dc71a065789/users/f6e5231fa08844b8b6744fd49e9fce9a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:09.476637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094723-509d-4402-9135-8728f160b15a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.477179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094723-509d-4402-9135-8728f160b15a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.477685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094723-509d-4402-9135-8728f160b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.529029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d9094723-509d-4402-9135-8728f160b15a None None] MFA Rules not processed for user `f6e5231fa08844b8b6744fd49e9fce9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:09.531588 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d9094723-509d-4402-9135-8728f160b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:09.645366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1130/2268] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:09 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:09.653083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:09.655343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:09.738055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618ad93-9bea-4a31-b064-47646ceb1af2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.742857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c1846-5445-4721-bfd1-04da3b988c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.743647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1846-5445-4721-bfd1-04da3b988c91 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.744017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1846-5445-4721-bfd1-04da3b988c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.744422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c1846-5445-4721-bfd1-04da3b988c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.756947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c1846-5445-4721-bfd1-04da3b988c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.758732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c1846-5445-4721-bfd1-04da3b988c91 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.770642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1139/2269] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:09 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:56:09.881224 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094723-509d-4402-9135-8728f160b15a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:09.891920 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094723-509d-4402-9135-8728f160b15a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:09.902738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:09.903867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.904223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.904981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.923590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:09.923875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:09.924386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:09.955606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] MFA Rules not processed for user `d9cdb673ba1f417b8cc0734ad38ed57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:09.956836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:09.972141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:09.974092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:09.988796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1131/2270] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:09 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:10.059852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1140/2271] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:10.079198 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:10.089774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366717-76c1-4e4c-973f-66ef21d62155 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:10.094254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b26445-adc8-4fa4-b982-3ab0f9752a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:10.094927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b26445-adc8-4fa4-b982-3ab0f9752a72 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:10.095211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b26445-adc8-4fa4-b982-3ab0f9752a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:10.096788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b26445-adc8-4fa4-b982-3ab0f9752a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:10.108128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b26445-adc8-4fa4-b982-3ab0f9752a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:10.109908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b26445-adc8-4fa4-b982-3ab0f9752a72 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:10.125819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1132/2272] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:10 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:10.416669 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:10.509921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f30ca-2415-4b39-be88-b76e1bbedd1b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:10.522916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:10.523824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:10.524110 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:10.524385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] PATH_INFO: `/v3/users/a17492adde6a4a0ab3d6efc9315c56dd` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:10.525801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17492adde6a4a0ab3d6efc9315c56dd)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:10.527861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:10.577986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17492adde6a4a0ab3d6efc9315c56dd'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:10.578670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17492adde6a4a0ab3d6efc9315c56dd'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:10.579285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17492adde6a4a0ab3d6efc9315c56dd'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:10.588201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17492adde6a4a0ab3d6efc9315c56dd'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:10.600278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17492adde6a4a0ab3d6efc9315c56dd'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:10.612662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1141/2273] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:10 2021] DELETE /identity/v3/users/a17492adde6a4a0ab3d6efc9315c56dd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:56:10.617347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:10.617630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:10.617906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:10.636207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:10.637374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:10.698512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1133/2274] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:10.709702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:10.711245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:10.778883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c582d-b603-4503-aadb-520fffac49c8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:10.783416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:10.784071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:10.784347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:10.784618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:10.794953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:10.796407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:10.806331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1142/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:11.123406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:11.124884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:11.138820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b8c0-0248-4b79-a12b-2fbd533f153b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:11.147305 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:11.148608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:11.149134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:11.149636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] PATH_INFO: `/v3/projects/ef4dd593cebd49648530c28b2f3f18e0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:11.151228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4dd593cebd49648530c28b2f3f18e0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:11.154835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:11.234131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4dd593cebd49648530c28b2f3f18e0', 'request_id': 'req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.252451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4dd593cebd49648530c28b2f3f18e0', 'request_id': 'req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.259164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4dd593cebd49648530c28b2f3f18e0', 'request_id': 'req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.273634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] The token cache is being invalidate because project ef4dd593cebd49648530c28b2f3f18e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:11.273928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.274677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.276522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1134/2276] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:11 2021] DELETE /identity/v3/projects/ef4dd593cebd49648530c28b2f3f18e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:11.281211 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:11.292059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e688d-eb74-49d7-9b81-e964d8baf8ab service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:11.353326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:11.354266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:11.354546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:11.354817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] PATH_INFO: `/v3/users/f6e5231fa08844b8b6744fd49e9fce9a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:11.356240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e5231fa08844b8b6744fd49e9fce9a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:11.358740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:11.422544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e5231fa08844b8b6744fd49e9fce9a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.424897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e5231fa08844b8b6744fd49e9fce9a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.425588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e5231fa08844b8b6744fd49e9fce9a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.440034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e5231fa08844b8b6744fd49e9fce9a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.459221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-dd459473-df76-430a-996f-5ba57f105a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e5231fa08844b8b6744fd49e9fce9a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:11.472948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1143/2277] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:11 2021] DELETE /identity/v3/users/f6e5231fa08844b8b6744fd49e9fce9a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:12.047873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.049395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:12.063491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8881b0-8aa8-4e21-994b-28ef76f80ac9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.139791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.148181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.151255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.151917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] PATH_INFO: `/v3/projects/8b395e4be74b4b2a94dc9dc71a065789` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.155058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b395e4be74b4b2a94dc9dc71a065789)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.159490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.267583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b395e4be74b4b2a94dc9dc71a065789', 'request_id': 'req-91b46358-9a14-475b-b0f1-30f82bb0850f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:12.279852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b395e4be74b4b2a94dc9dc71a065789', 'request_id': 'req-91b46358-9a14-475b-b0f1-30f82bb0850f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:12.286703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b395e4be74b4b2a94dc9dc71a065789', 'request_id': 'req-91b46358-9a14-475b-b0f1-30f82bb0850f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:12.299352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] The token cache is being invalidate because project 8b395e4be74b4b2a94dc9dc71a065789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:12.299652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:12.300373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-91b46358-9a14-475b-b0f1-30f82bb0850f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:12.302438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1135/2278] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:12 2021] DELETE /identity/v3/projects/8b395e4be74b4b2a94dc9dc71a065789 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:12.310232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.311077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.311408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.332008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:12.333259 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:12.399348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1144/2279] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:12.408993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.409543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.410041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.430122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:12.431187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:12.444651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1136/2280] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:12.449645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.461128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0255f-d5b2-433d-8464-76238c1ec7b8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.467102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.467896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.468395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.468939 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.469767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:56:12.470291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.472294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.485711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1145/2281] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:56:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 15:56:12.490421 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.500617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec399db-11f7-4506-bb60-42859a69b2e7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.514644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788ff87-95f9-4a64-ac45-6c4bdabce870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.514644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788ff87-95f9-4a64-ac45-6c4bdabce870 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.514644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788ff87-95f9-4a64-ac45-6c4bdabce870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.514644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788ff87-95f9-4a64-ac45-6c4bdabce870 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.515119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788ff87-95f9-4a64-ac45-6c4bdabce870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.515119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788ff87-95f9-4a64-ac45-6c4bdabce870 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.558252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1137/2282] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:12 2021] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:12.560890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.572354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cf82c-235c-42a3-aa13-0dc4e853539f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.645063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.645774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.646057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.646569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.647491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.649493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.675428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1146/2283] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:12 2021] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:56:12.680060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ae35-db40-49e0-a73b-09118b74bb82 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.680348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ae35-db40-49e0-a73b-09118b74bb82 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.680809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ae35-db40-49e0-a73b-09118b74bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.687187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.698994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae84c-064f-4842-9c2f-f9f4892a5063 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.703227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-8681ae35-db40-49e0-a73b-09118b74bb82 None None] MFA Rules not processed for user `d9cdb673ba1f417b8cc0734ad38ed57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:12.704750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8681ae35-db40-49e0-a73b-09118b74bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:12.705062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.705731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.706005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.706671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.707314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.708972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.733189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1147/2284] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:12 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:12.734903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.748929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71d97c-749f-465b-ac6a-34c58c3d4420 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.757227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.757920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.758246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.758532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.759394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.762031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.776167 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1148/2285] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:56:12.790004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:12.812065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1138/2286] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:12.828750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd77db-488b-4775-ac43-a958b579c4d0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:12.851406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:12.852325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.852600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.852873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] PATH_INFO: `/v3/projects/dd267c8ea8e646dbbb902d8b5f8c31a0/users/2c17a5a54a8b40f9901f9b86b4353955/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.873099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd267c8ea8e646dbbb902d8b5f8c31a0, user_id=2c17a5a54a8b40f9901f9b86b4353955, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:12.880587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:12.934287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1149/2287] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:12 2021] PUT /identity/v3/projects/dd267c8ea8e646dbbb902d8b5f8c31a0/users/2c17a5a54a8b40f9901f9b86b4353955/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:12.939739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea905-65f1-4b03-9f00-7e0becf00a02 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:12.940026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea905-65f1-4b03-9f00-7e0becf00a02 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:12.940360 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea905-65f1-4b03-9f00-7e0becf00a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:12.965615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-fa8ea905-65f1-4b03-9f00-7e0becf00a02 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:12.967720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fa8ea905-65f1-4b03-9f00-7e0becf00a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:13.047486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1139/2288] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:13.057544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:13.059421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:13.146980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2c745-4ee0-4682-8f31-fd464ac7ad27 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:13.151285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:13.151936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:13.152210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:13.152504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:13.167495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:13.171027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:13.191248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1150/2289] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:14.274677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccae32-0675-41fb-a5c6-4a0046645b6b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:14.275791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccae32-0675-41fb-a5c6-4a0046645b6b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:14.276276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccae32-0675-41fb-a5c6-4a0046645b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:14.373136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-daccae32-0675-41fb-a5c6-4a0046645b6b None None] MFA Rules not processed for user `2c17a5a54a8b40f9901f9b86b4353955`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:14.375446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-daccae32-0675-41fb-a5c6-4a0046645b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:14.632144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1140/2290] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:14.651653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:14.660933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:14.840753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff32ae-bbd1-4649-91dd-9267e1d92d7b service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:14.846904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8820a6-5d5f-431f-bd85-ee9de43d9579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:14.848436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8820a6-5d5f-431f-bd85-ee9de43d9579 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:14.848436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8820a6-5d5f-431f-bd85-ee9de43d9579 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:14.848436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8820a6-5d5f-431f-bd85-ee9de43d9579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:14.872495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8820a6-5d5f-431f-bd85-ee9de43d9579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:14.875080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8820a6-5d5f-431f-bd85-ee9de43d9579 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:14.890310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1151/2291] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:14 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:16.558520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6685-784a-4ef8-8cdf-1514a99ba58f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:16.559155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6685-784a-4ef8-8cdf-1514a99ba58f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:16.559155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd6685-784a-4ef8-8cdf-1514a99ba58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:16.592933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-10dd6685-784a-4ef8-8cdf-1514a99ba58f None None] MFA Rules not processed for user `2c17a5a54a8b40f9901f9b86b4353955`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:16.594488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-10dd6685-784a-4ef8-8cdf-1514a99ba58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:16.611525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1141/2292] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:16 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:24.487715 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:24.490377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:24.490797 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:24.527265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] MFA Rules not processed for user `d50d9103fa7d4f74bd77defac782f225`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:24.530020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:24.629132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1152/2293] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:24 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:34.402973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dbd89-83cc-46e1-81f9-bbb85607934c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:34.404285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dbd89-83cc-46e1-81f9-bbb85607934c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:34.404961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dbd89-83cc-46e1-81f9-bbb85607934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:34.448574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-233dbd89-83cc-46e1-81f9-bbb85607934c None None] MFA Rules not processed for user `d9cdb673ba1f417b8cc0734ad38ed57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:34.451461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-233dbd89-83cc-46e1-81f9-bbb85607934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:34.587732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1142/2294] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:55.415581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:55.417166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:55.513415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9191-ac15-4609-8603-7849bca2c9e2 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:55.520029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:55.521151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:55.521434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:55.521709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] PATH_INFO: `/v3/users/a01d78ca634846c085245525cf4f0a8c` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:55.523131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01d78ca634846c085245525cf4f0a8c)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:55.525226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:55.586129 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01d78ca634846c085245525cf4f0a8c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:55.587133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01d78ca634846c085245525cf4f0a8c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:55.587641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01d78ca634846c085245525cf4f0a8c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:55.599787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01d78ca634846c085245525cf4f0a8c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:55.619651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01d78ca634846c085245525cf4f0a8c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:55.637785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1153/2295] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:55 2021] DELETE /identity/v3/users/a01d78ca634846c085245525cf4f0a8c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:55.639874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:55.640345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:55.640808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:55.679784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:55.681012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:55.743427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1143/2296] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:55.755483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:55.757111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:55.871976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cb385-927e-4be5-9c95-90b0b02e8aff admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:55.876130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:55.876811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:55.877093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:55.877368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:55.888534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:55.890103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:55.900986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1154/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:56.215846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.218009 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:56.234967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54805c-0825-4e8e-bb3b-7af4489d172f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.246903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.249109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.253662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.254151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] PATH_INFO: `/v3/users/50be32c542ac44929b7d2149d41170f8` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.258428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50be32c542ac44929b7d2149d41170f8)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.260730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.359564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50be32c542ac44929b7d2149d41170f8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.360443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50be32c542ac44929b7d2149d41170f8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.362087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50be32c542ac44929b7d2149d41170f8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.374696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50be32c542ac44929b7d2149d41170f8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.383583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.385542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:56.398501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5b3d5f9c-d9a9-4386-9732-f80ef9d0236f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50be32c542ac44929b7d2149d41170f8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.414629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fbd72-0b26-4e1c-9704-562ef12a6391 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.421339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.422419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.422567 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.422776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] PATH_INFO: `/v3/projects/c105f319bb0c48cb97b3596b649449fa` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.426039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c105f319bb0c48cb97b3596b649449fa)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.428294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.428671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1144/2298] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:56 2021] DELETE /identity/v3/users/50be32c542ac44929b7d2149d41170f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:56.435343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.435892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.436440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.471264 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:56.473299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:56.495988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c105f319bb0c48cb97b3596b649449fa', 'request_id': 'req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.506526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c105f319bb0c48cb97b3596b649449fa', 'request_id': 'req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.513915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c105f319bb0c48cb97b3596b649449fa', 'request_id': 'req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.527239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] The token cache is being invalidate because project c105f319bb0c48cb97b3596b649449fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:56.527566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.528334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f0851e2a-5370-43d5-8e01-9e5e9fb4a1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:56.530048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1155/2299] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:56 2021] DELETE /identity/v3/projects/c105f319bb0c48cb97b3596b649449fa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:56.540369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0aff-7267-454f-829e-72b929a43963 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.540938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0aff-7267-454f-829e-72b929a43963 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.541419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0aff-7267-454f-829e-72b929a43963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.565155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1145/2300] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:56.577094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.578650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:56.606735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0c4e0aff-7267-454f-829e-72b929a43963 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:56.608096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0c4e0aff-7267-454f-829e-72b929a43963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:56.627069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1156/2301] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:56.632486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.632770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.633044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.647963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e2a6-58cc-442a-a9e4-ea44b871ee7b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.653048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:56.653275 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.653914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.654290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.654439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:56.654714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.663952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1157/2302] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:56.668371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.668676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.670322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.680642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9321-56b8-471c-9ec5-490433cc6efb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.680922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1146/2303] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:56:56.686631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.687314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.687598 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.687885 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.688717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:56:56.689036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.690743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.711659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1158/2304] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:56:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:56:56.712842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.723522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2e15-7e1d-4dbf-8625-ac732d1850b6 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.730361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.731364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.731786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.732295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.733523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.735863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.773649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1147/2305] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:56 2021] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:56.775155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.793948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919564e3-8a3e-41b7-a580-99332fc66110 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.867222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.867927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.868202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.868480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.869210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.871278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.903789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1159/2306] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:56 2021] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:56.908106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.919310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf520-b74f-43c6-8373-029ef961eaae admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.924148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.924857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.925137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.925441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.926201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.928010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.940161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1148/2307] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 15:56:56.945494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:56.957468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27f265-58b5-415e-ab28-ac79c94c283e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:56.963626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ead77-cbc2-45fd-bc5a-640ca84ebb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:56.963626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ead77-cbc2-45fd-bc5a-640ca84ebb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:56.963970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ead77-cbc2-45fd-bc5a-640ca84ebb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:56.964364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ead77-cbc2-45fd-bc5a-640ca84ebb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:56.966183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ead77-cbc2-45fd-bc5a-640ca84ebb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:56.968458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ead77-cbc2-45fd-bc5a-640ca84ebb54 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:56.981790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1160/2308] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:56 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:56.986288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.001333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2596a-f91d-45b4-bf56-bc82a68f7d0c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.009547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.010915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.012784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.013087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] PATH_INFO: `/v3/projects/5a4f25c5e5374408a222bba68fa16fb2/users/c0f9b5008dc64939b7e9963ed82f8d57/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.041208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4f25c5e5374408a222bba68fa16fb2, user_id=c0f9b5008dc64939b7e9963ed82f8d57, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.045019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.067220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1149/2309] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:56 2021] PUT /identity/v3/projects/5a4f25c5e5374408a222bba68fa16fb2/users/c0f9b5008dc64939b7e9963ed82f8d57/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:56:57.080062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.080062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.080062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.086939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.090405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.118113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] MFA Rules not processed for user `c0f9b5008dc64939b7e9963ed82f8d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:57.120235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.171337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a948cf-4f0c-4a16-a431-0934f7083e6d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.176878 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.177890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.178304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.178673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] PATH_INFO: `/v3/projects/2725ba365efe479184044631f591e663` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.179996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2725ba365efe479184044631f591e663)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.182148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.193352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1161/2310] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:57.205186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.206651 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.236798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2725ba365efe479184044631f591e663', 'request_id': 'req-4d794687-1b25-49c6-a463-c3d745a5cd3e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.249364 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2725ba365efe479184044631f591e663', 'request_id': 'req-4d794687-1b25-49c6-a463-c3d745a5cd3e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.256425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2725ba365efe479184044631f591e663', 'request_id': 'req-4d794687-1b25-49c6-a463-c3d745a5cd3e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.270210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] The token cache is being invalidate because project 2725ba365efe479184044631f591e663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:57.270797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.271633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-4d794687-1b25-49c6-a463-c3d745a5cd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.273627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1150/2311] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:57 2021] DELETE /identity/v3/projects/2725ba365efe479184044631f591e663 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:57.281378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33401e5b-4074-4802-a13e-6a4429febfe2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.282416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33401e5b-4074-4802-a13e-6a4429febfe2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.282825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5e2f2-25ab-4790-9868-23a464c45c81 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.283120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33401e5b-4074-4802-a13e-6a4429febfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.307911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-33401e5b-4074-4802-a13e-6a4429febfe2 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:57.309995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-33401e5b-4074-4802-a13e-6a4429febfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.348543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.349312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.349599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.349872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.352076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.435141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1151/2312] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:56:57.445756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.450032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.450348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.460635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.463995 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.477421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1162/2313] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:57 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:56:57.488895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:57.489058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.500610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1152/2314] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:57.505367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.514620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.516587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.518354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed734b-77d1-4601-8fba-77ce9c170f0b service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.523439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.524228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.524611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.524993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.525875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 15:56:57.526386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.528890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.531218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652a0c8-df33-4501-a302-26882044cfc7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.537561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.539026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.539313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.539592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] PATH_INFO: `/v3/users/c0f9b5008dc64939b7e9963ed82f8d57` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.541695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f9b5008dc64939b7e9963ed82f8d57)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.544436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.549811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1163/2315] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 15:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 15:56:57.552164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.565967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce045-8176-4bd6-aaec-e37480dd2119 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.573993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.574804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.575093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.575369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.576229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.578246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.609740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f9b5008dc64939b7e9963ed82f8d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.611162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f9b5008dc64939b7e9963ed82f8d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.612119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f9b5008dc64939b7e9963ed82f8d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.624315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f9b5008dc64939b7e9963ed82f8d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.634585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1164/2316] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 15:56:57 2021] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 15:56:57.636369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.639972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.644073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-acfd9ca2-066b-4f78-95df-adc8e6afdb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f9b5008dc64939b7e9963ed82f8d57'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:57.678419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1153/2317] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 15:56:57 2021] DELETE /identity/v3/users/c0f9b5008dc64939b7e9963ed82f8d57 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:56:57.683430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.683905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.684225 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.735385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:57.736618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.767818 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af542-c8e5-4a05-bcc9-4f8cfca5b4d3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.801075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1154/2318] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:57.811718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.813956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:57.832616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.833471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.833749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.834368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.835242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.837185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.860780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1165/2319] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 15:56:57 2021] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 15:56:57.865480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.877180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3807678-46d8-4998-8a18-fafcb1e8bb90 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.883923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.884448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.884744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.885005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.885350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0cb64-0e5b-4b45-a8b2-d5d234be1fda None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.885778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.887621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.890942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.891485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.891773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.892053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.899827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1166/2320] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:57.904491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.906068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.908214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.915056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381295b-d53c-4ce8-847e-0342a567b435 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.919596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1155/2321] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:57.922953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05622-5737-4ad3-9ee0-520a4e9df17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.923656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05622-5737-4ad3-9ee0-520a4e9df17c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.924095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05622-5737-4ad3-9ee0-520a4e9df17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.924381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05622-5737-4ad3-9ee0-520a4e9df17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.925175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a05622-5737-4ad3-9ee0-520a4e9df17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.926966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a05622-5737-4ad3-9ee0-520a4e9df17c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:57.937645 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1167/2322] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 15:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 15:56:57.942050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:57.955025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc84db1-0bb4-4433-bf7a-e45085f53451 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:57.959289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:57.960377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:57.960889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:57.961266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] PATH_INFO: `/v3/projects/65d800b461854d12b3c94a486da8922c/users/8982620a6c8a43958f911e44dda83783/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:57.982911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d800b461854d12b3c94a486da8922c, user_id=8982620a6c8a43958f911e44dda83783, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:57.988344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:58.006924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1156/2323] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 15:56:57 2021] PUT /identity/v3/projects/65d800b461854d12b3c94a486da8922c/users/8982620a6c8a43958f911e44dda83783/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 15:56:58.018174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:58.018481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:58.018758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:58.062913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] MFA Rules not processed for user `8982620a6c8a43958f911e44dda83783`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:58.064208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:58.211155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1168/2324] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:58.226921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:58.229508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:58.305516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:58.307903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:58.402519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa979d46-e990-4b68-8cc6-2e64211231ad admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:58.411324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa518efa-37df-4fbc-87d3-01518b120cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:58.412244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518efa-37df-4fbc-87d3-01518b120cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:58.412845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518efa-37df-4fbc-87d3-01518b120cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:58.413194 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa518efa-37df-4fbc-87d3-01518b120cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:58.426074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518efa-37df-4fbc-87d3-01518b120cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:58.428933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa518efa-37df-4fbc-87d3-01518b120cd0 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:58.430485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311d50-6c7c-4934-911b-41f57337e4fc None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:58.436601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:58.437500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:58.437842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:58.438287 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] PATH_INFO: `/v3/projects/5a4f25c5e5374408a222bba68fa16fb2` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:58.439473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4f25c5e5374408a222bba68fa16fb2)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:58.441473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:58.444170 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1157/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:56:58 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:56:58.585189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4f25c5e5374408a222bba68fa16fb2', 'request_id': 'req-f743b962-efb5-47d3-ac93-e6b09209b293'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:58.595605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4f25c5e5374408a222bba68fa16fb2', 'request_id': 'req-f743b962-efb5-47d3-ac93-e6b09209b293'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:58.604347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4f25c5e5374408a222bba68fa16fb2', 'request_id': 'req-f743b962-efb5-47d3-ac93-e6b09209b293'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:58.618746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] The token cache is being invalidate because project 5a4f25c5e5374408a222bba68fa16fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 15:56:58.619430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:58.620364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f743b962-efb5-47d3-ac93-e6b09209b293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 15:56:58.622319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1169/2326] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 15:56:58 2021] DELETE /identity/v3/projects/5a4f25c5e5374408a222bba68fa16fb2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 15:56:59.104591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:59.104591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:59.105070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:59.132410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] MFA Rules not processed for user `d50d9103fa7d4f74bd77defac782f225`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:59.133809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:59.241693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1158/2327] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:56:59 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:59.632597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c63a-e2ba-4180-9c4a-a731a5f2bf72 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:59.633215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c63a-e2ba-4180-9c4a-a731a5f2bf72 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:59.633215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c63a-e2ba-4180-9c4a-a731a5f2bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:59.678732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3997c63a-e2ba-4180-9c4a-a731a5f2bf72 None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:56:59.680388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3997c63a-e2ba-4180-9c4a-a731a5f2bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:59.773408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1170/2328] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:56:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:56:59.844647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:56:59.847254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:56:59.931523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e7c81-4c6e-4214-abb0-39260b246a7f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:56:59.938890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b011a-3317-47ea-992f-4424ca342a9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:56:59.939634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b011a-3317-47ea-992f-4424ca342a9a service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:56:59.939982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b011a-3317-47ea-992f-4424ca342a9a service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:56:59.940321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b011a-3317-47ea-992f-4424ca342a9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:56:59.953971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b011a-3317-47ea-992f-4424ca342a9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:56:59.955918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b011a-3317-47ea-992f-4424ca342a9a service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:56:59.967607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1159/2329] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:56:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:57:00.092686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:00.092981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:00.093281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:00.127836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] MFA Rules not processed for user `8982620a6c8a43958f911e44dda83783`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:00.130078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:00.233912 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1171/2330] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 15:57:00 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 15:57:10.285821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14432eaf-dcca-4b71-858f-5b320222aeae None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:10.287093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14432eaf-dcca-4b71-858f-5b320222aeae None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:10.287093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14432eaf-dcca-4b71-858f-5b320222aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:10.321423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-14432eaf-dcca-4b71-858f-5b320222aeae None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:10.322936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-14432eaf-dcca-4b71-858f-5b320222aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:10.347200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1160/2331] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:57:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:10.363799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:10.381268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2a90b-3313-478f-9e22-725ed7aaac6c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:10.390213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b93c6-e34d-40c4-8b31-6b2fe98a2657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:10.391060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b93c6-e34d-40c4-8b31-6b2fe98a2657 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:10.391356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b93c6-e34d-40c4-8b31-6b2fe98a2657 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:10.391823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b93c6-e34d-40c4-8b31-6b2fe98a2657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:10.402198 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b93c6-e34d-40c4-8b31-6b2fe98a2657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:10.404130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b93c6-e34d-40c4-8b31-6b2fe98a2657 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:10.423227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1172/2332] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:57:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:57:21.557471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0d942-2075-47e3-a0ae-b738d7c695bd None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:21.558101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0d942-2075-47e3-a0ae-b738d7c695bd None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:21.558752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0d942-2075-47e3-a0ae-b738d7c695bd None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:21.562554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1161/2333] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:57:21 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 10 15:57:21.582555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843541-d19d-4051-90b2-9873eb56d94e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:21.583969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843541-d19d-4051-90b2-9873eb56d94e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:21.584821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843541-d19d-4051-90b2-9873eb56d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:21.688536 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-78843541-d19d-4051-90b2-9873eb56d94e None None] MFA Rules not processed for user `599ea3b3d1f5426ea3218ecb443ca0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:21.690463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-78843541-d19d-4051-90b2-9873eb56d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:21.798330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1173/2334] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:57:21 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:21.820338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0d942-2075-47e3-a0ae-b738d7c695bd None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:21.824901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-43e0d942-2075-47e3-a0ae-b738d7c695bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:21.978132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0d942-2075-47e3-a0ae-b738d7c695bd None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:21.983151 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083ed7-40ba-4ff0-ac2f-b0ae0f8871c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:21.984161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083ed7-40ba-4ff0-ac2f-b0ae0f8871c2 service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:21.984497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083ed7-40ba-4ff0-ac2f-b0ae0f8871c2 service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:21.985080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083ed7-40ba-4ff0-ac2f-b0ae0f8871c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:22.015926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31083ed7-40ba-4ff0-ac2f-b0ae0f8871c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:22.017714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31083ed7-40ba-4ff0-ac2f-b0ae0f8871c2 service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:22.054592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1162/2335] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:57:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:57:22.219279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663b99-a3cf-466e-96c8-377e001d1d20 None None] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:22.219851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663b99-a3cf-466e-96c8-377e001d1d20 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:22.220322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663b99-a3cf-466e-96c8-377e001d1d20 None None] PATH_INFO: `/` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:22.222498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1174/2336] 10.222.0.60 () {54 vars in 921 bytes} [Wed Nov 10 15:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 15:57:22.239425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b9eb0-c089-4b65-a0f7-18302a8e471f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:22.246923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b9eb0-c089-4b65-a0f7-18302a8e471f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:22.247626 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b9eb0-c089-4b65-a0f7-18302a8e471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:22.352749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-828b9eb0-c089-4b65-a0f7-18302a8e471f None None] MFA Rules not processed for user `2ecc2dca57d045869f1fcf3a4337b990`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:22.356498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-828b9eb0-c089-4b65-a0f7-18302a8e471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:22.485709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1163/2337] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Nov 10 15:57:22 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:22.508861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0663b99-a3cf-466e-96c8-377e001d1d20 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:22.511659 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a0663b99-a3cf-466e-96c8-377e001d1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:22.551579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0663b99-a3cf-466e-96c8-377e001d1d20 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:22.623559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:22.624972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:22.624972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:22.624972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:22.643155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:22.644757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:22.654963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1175/2338] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:57:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 15:57:29.822223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236c99-d003-4360-9ed9-fdf933e40dab None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:29.822947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236c99-d003-4360-9ed9-fdf933e40dab None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:29.823299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236c99-d003-4360-9ed9-fdf933e40dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:29.857568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7c236c99-d003-4360-9ed9-fdf933e40dab None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:29.859017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7c236c99-d003-4360-9ed9-fdf933e40dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:29.867179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1164/2339] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:57:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:29.890868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:29.905835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d3dc-170f-4016-af8f-0fa35f310d0f service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:29.912767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:29.913505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:29.913858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:29.914233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:29.927838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:29.929675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:29.941862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1176/2340] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:57:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:57:31.164525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa383c-113f-45ec-a609-1109f2634d5f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:31.165102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa383c-113f-45ec-a609-1109f2634d5f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:31.165193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa383c-113f-45ec-a609-1109f2634d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:31.230443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-05aa383c-113f-45ec-a609-1109f2634d5f None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:31.230443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-05aa383c-113f-45ec-a609-1109f2634d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:31.241109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1165/2341] 10.222.0.60 () {58 vars in 967 bytes} [Wed Nov 10 15:57:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:31.263006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:31.281407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759da9b6-4e58-4d59-a9d3-add8b25af163 service swift] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:31.288562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:31.289420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:31.289822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:31.290277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:31.303180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:31.305491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:31.325059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1177/2342] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:57:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:57:31.693941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a5f7-d39f-4274-9ef2-308a6d78a7ad None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:31.694618 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a5f7-d39f-4274-9ef2-308a6d78a7ad None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:31.694958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75a5f7-d39f-4274-9ef2-308a6d78a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:31.720042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6a75a5f7-d39f-4274-9ef2-308a6d78a7ad None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:31.722125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6a75a5f7-d39f-4274-9ef2-308a6d78a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:31.734502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1166/2343] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 15:57:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:31.756881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:31.770019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c1d7-aab6-4582-8b61-c77d89ae61f3 service swift] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:31.777013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:31.777850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:31.778474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:31.778851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:31.796711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:31.800495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:31.814987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1178/2344] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:57:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:57:32.238950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:32.239753 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:32.240338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:32.274960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 15:57:32.277200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:57:32.290076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1167/2345] 10.222.0.60 () {58 vars in 967 bytes} [Wed Nov 10 15:57:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 15:57:32.306500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:57:32.318505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115cb9-ba61-4c96-9012-63b771f84317 service swift] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:57:32.324764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:57:32.325451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:57:32.325734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:57:32.326009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:57:32.336346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:57:32.337991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:57:32.348313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1179/2346] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 15:57:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 15:58:46.445300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:58:46.446745 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:58:46.543276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a22f38-a2be-43cc-a236-16cec2565090 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:58:46.548531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:58:46.549359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:58:46.549657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:58:46.549926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:58:46.552022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:58:46.564156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:58:46.565739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:58:46.576465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1168/2347] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:58:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:59:41.143091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:59:41.144615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:41.158130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8fe99-1745-4dd3-826f-c02d7eb691ef service swift] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:59:41.162410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:59:41.163066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:59:41.163347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:59:41.163626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:59:41.165585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:41.180610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:59:41.182074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:59:41.194373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1180/2348] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:59:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:59:42.393215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:59:42.403667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbfb20-470c-4026-94fb-11709dc59dd5 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:59:42.408746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:59:42.409950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:59:42.411027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:59:42.411027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:59:42.413397 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:42.431179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:59:42.432948 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:59:42.446601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1169/2349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:59:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:59:56.873901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:59:56.876378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:56.894903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f8c98-e8fd-4515-a3c1-a4129e7b087d service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:59:56.901913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:59:56.905234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:59:56.905234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:59:56.905234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:59:56.907842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:56.987401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:59:56.989230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:59:57.000146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1181/2350] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:59:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 15:59:57.266984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 15:59:57.268601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:57.287319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664753-f6f6-4098-aa18-9eb00d569721 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 15:59:57.293708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 15:59:57.294394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 15:59:57.294670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 15:59:57.294942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 15:59:57.296844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 15:59:57.363437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 15:59:57.364966 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 15:59:57.375498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1170/2351] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 15:59:57 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:00:48.582479 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:00:48.602530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da6054-c684-4ede-a8ef-58f89c6a833e service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:00:48.612907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:00:48.614042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:00:48.614768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:00:48.615191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:00:48.618394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:00:48.638062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:00:48.640634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:00:48.658142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1182/2352] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:00:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:00:51.118083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:00:51.129900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0166e27-5266-48de-8a0f-1cdeadf77846 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:00:51.134342 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:00:51.135253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:00:51.135539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:00:51.135847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:00:51.138249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:00:51.150255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:00:51.152752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:00:51.162954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1171/2353] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:00:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:01:10.825090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:01:10.826824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:01:10.915343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0a9d7-7b8d-4070-8f29-b292648236f7 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:01:10.919955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:01:10.920611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:01:10.920892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:01:10.921210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:01:10.923085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:01:10.986356 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:01:10.987805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:01:10.996991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1183/2354] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:01:10 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:01:15.263811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:01:15.281795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad99ff5-9d67-46dd-9eb9-ad9d8ad51ff9 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:01:15.286939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:01:15.287670 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:01:15.287952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:01:15.288230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:01:15.290365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:01:15.358557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:01:15.359969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8b119-b653-46b9-9b75-c9bf34e29166 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:01:15.369904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1172/2355] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:01:15 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:01:57.949829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:01:57.960303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd94ac-2900-41d5-9e29-507a4b2e0d05 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:01:57.968952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:01:57.969760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:01:57.970295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:01:57.970553 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:01:57.972871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:01:57.986595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:01:57.988634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:01:58.000539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1184/2356] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:01:57 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:22.098379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659e3b-99dd-4017-a8b1-8692787b29d8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:22.098946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659e3b-99dd-4017-a8b1-8692787b29d8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:22.098946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58659e3b-99dd-4017-a8b1-8692787b29d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:22.149463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-58659e3b-99dd-4017-a8b1-8692787b29d8 None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:22.150736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-58659e3b-99dd-4017-a8b1-8692787b29d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:22.168905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1173/2357] 10.222.0.60 () {58 vars in 967 bytes} [Wed Nov 10 16:03:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:03:22.219210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:22.251284 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8163-9243-4b61-80bf-ce721e0c759d service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:22.257099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35536a45-9839-4560-9e72-e26cb8172109 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:22.257799 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35536a45-9839-4560-9e72-e26cb8172109 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:22.258061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35536a45-9839-4560-9e72-e26cb8172109 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:22.258368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35536a45-9839-4560-9e72-e26cb8172109 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:22.267426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35536a45-9839-4560-9e72-e26cb8172109 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:22.269064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35536a45-9839-4560-9e72-e26cb8172109 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:22.278114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1185/2358] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 16:03:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 16:03:23.926726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bf407-0929-4634-b1cd-8e5841a86a2f None None] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:23.927298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bf407-0929-4634-b1cd-8e5841a86a2f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:23.927298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bf407-0929-4634-b1cd-8e5841a86a2f None None] PATH_INFO: `/` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:23.929142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1174/2359] 10.222.0.60 () {54 vars in 912 bytes} [Wed Nov 10 16:03:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 10 16:03:23.936544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:23.937095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:23.937095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:23.977411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] MFA Rules not processed for user `e88500f303d44f67a828798654c72b46`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:23.978789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:23.989003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1186/2360] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 16:03:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:03:24.013600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bf407-0929-4634-b1cd-8e5841a86a2f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:24.028349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bf407-0929-4634-b1cd-8e5841a86a2f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:24.033436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b16b0-055d-4c39-9225-a84820ff346e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:24.034084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b16b0-055d-4c39-9225-a84820ff346e service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:24.034476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b16b0-055d-4c39-9225-a84820ff346e service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:24.034784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b16b0-055d-4c39-9225-a84820ff346e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:24.044134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b16b0-055d-4c39-9225-a84820ff346e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:24.045763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b16b0-055d-4c39-9225-a84820ff346e service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:24.055817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1175/2361] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:24.245296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:24.255627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5e265-68b6-4835-9f60-167b33dd976b None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:24.263569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:24.264246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:24.264529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:24.264804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:24.266769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:24.280213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:24.281824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:24.292698 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1187/2362] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:26.833172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:26.833734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:26.833734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:26.853888 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] MFA Rules not processed for user `9f70acf2d84d44c896f1d284b84fa9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:26.855155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:26.863020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1176/2363] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:03:26 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:03:27.204854 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:27.215802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62950d-166d-4496-8d5e-29437ad3beb3 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:27.220130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:27.220796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:27.221073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:27.221384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:27.223246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:27.233368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:27.234841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30dbec-f0dc-450a-b317-88df91866405 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:27.244337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1188/2364] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:27.572693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:27.574102 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:27.588886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b8139-0def-49b9-8948-e3ab267da4f8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:27.594188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:27.594847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:27.595126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:27.595400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:27.597325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:27.609821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:27.611701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:27.623544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1177/2365] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:31.972373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:31.972916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:31.972916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:31.994315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:31.995569 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:32.003530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1189/2366] 10.222.0.60 () {58 vars in 967 bytes} [Wed Nov 10 16:03:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:03:32.019608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:32.034112 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45be4-2bab-40f7-9319-e05ca9274091 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:32.041014 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:32.041679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:32.041958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:32.042340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:32.051746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:32.053475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:32.062532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1178/2367] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 16:03:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 16:03:32.527366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:32.537033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac0fbe-1775-4df4-b9fb-faf9ee2f2162 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:32.540872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:32.541578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:32.542064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:32.542369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:32.544338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:32.610958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:32.612506 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:32.622145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1190/2368] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:33.163345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:33.165454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:33.182461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17838600-27af-4fa4-81f1-45dc9b85f710 service swift] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:33.188373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:33.189233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.189534 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.189812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] PATH_INFO: `/v3/users/d9cdb673ba1f417b8cc0734ad38ed57f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.191186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9cdb673ba1f417b8cc0734ad38ed57f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:33.193175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:33.246423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9cdb673ba1f417b8cc0734ad38ed57f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.247440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9cdb673ba1f417b8cc0734ad38ed57f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.248603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9cdb673ba1f417b8cc0734ad38ed57f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.259338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9cdb673ba1f417b8cc0734ad38ed57f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.274873 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-93c9bf28-e976-4e6d-956a-e89b797848e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9cdb673ba1f417b8cc0734ad38ed57f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.287176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1179/2369] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:03:33 2021] DELETE /identity/v3/users/d9cdb673ba1f417b8cc0734ad38ed57f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:03:33.471097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:33.487312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799eb85-212f-4250-b3b5-79ecf05a8602 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:33.553027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:33.553914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.554212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.554503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] PATH_INFO: `/v3/projects/20ca518d4ee447b3b7ad79544ec13e0d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.557240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ca518d4ee447b3b7ad79544ec13e0d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:33.559106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:33.615892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ca518d4ee447b3b7ad79544ec13e0d', 'request_id': 'req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.627326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ca518d4ee447b3b7ad79544ec13e0d', 'request_id': 'req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.633782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ca518d4ee447b3b7ad79544ec13e0d', 'request_id': 'req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.647268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] The token cache is being invalidate because project 20ca518d4ee447b3b7ad79544ec13e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:03:33.647268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.648052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.655472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1191/2370] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:03:33 2021] DELETE /identity/v3/projects/20ca518d4ee447b3b7ad79544ec13e0d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:03:33.657730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c237c-f213-4a62-8b84-1a56c1684000 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.658220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c237c-f213-4a62-8b84-1a56c1684000 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.658506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c237c-f213-4a62-8b84-1a56c1684000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.678104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-329c237c-f213-4a62-8b84-1a56c1684000 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:33.679453 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-329c237c-f213-4a62-8b84-1a56c1684000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:33.745071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:33.746788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:33.770514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1180/2371] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:03:33.780434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.780744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.780995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.801182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:33.802435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:33.811215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1181/2372] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:03:33.816773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:33.824332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86e1e8-2530-4c89-8306-f2f6cefa1ff1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:33.832192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:33.833678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.833784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a26b27-c73a-43ee-953f-b34fbf6e47a8 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:33.834209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.834737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] PATH_INFO: `/v3/users/8982620a6c8a43958f911e44dda83783` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.836901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8982620a6c8a43958f911e44dda83783)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:33.839326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:33.839487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:33.840176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.840539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.840824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.841725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:03:33.842031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:33.843841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:33.862358 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1182/2373] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 16:03:33.867277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:33.877882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a041-a89d-485f-948a-033e1d08ad03 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:33.883389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:33.884187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.884506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.884705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.885430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:33.887462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:33.898827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8982620a6c8a43958f911e44dda83783'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.899768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8982620a6c8a43958f911e44dda83783'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.900385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8982620a6c8a43958f911e44dda83783'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.908366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8982620a6c8a43958f911e44dda83783'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.921312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-35125965-6bd4-471d-bcd6-66c0f540afa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8982620a6c8a43958f911e44dda83783'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:33.928400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1183/2374] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:03:33 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:03:33.932834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:33.934478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:33.935112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1192/2375] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:03:33 2021] DELETE /identity/v3/users/8982620a6c8a43958f911e44dda83783 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:03:33.939515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:33.939807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:33.940078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:33.961986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:33.963246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:34.010325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbcfe5-fff9-4935-a72a-9c705f56a959 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.029638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1193/2376] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:03:34.040188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:34.041604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:34.069030 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.069811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.070229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.070357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.071032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.072959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.096438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1184/2377] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:03:33 2021] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:03:34.100147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:34.104283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf0eb3-e9ea-4fac-a3e7-eb264fa7a4f6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.109068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.109927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.110244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.110476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124661d7-a305-4d0c-a2ba-08514509c4cc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.110585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.115534 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.116243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.116523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.116806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.117603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.119499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.123734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.125552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.130592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1185/2378] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:03:34.134321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:34.137091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1194/2379] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:03:34.148023 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1876e-70fb-4284-9efc-fbe2cbd148eb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.153107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654300f-32c5-4a3c-bd03-9422b9c79284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.154231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654300f-32c5-4a3c-bd03-9422b9c79284 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.154667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654300f-32c5-4a3c-bd03-9422b9c79284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.154999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654300f-32c5-4a3c-bd03-9422b9c79284 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.155918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654300f-32c5-4a3c-bd03-9422b9c79284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.157634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654300f-32c5-4a3c-bd03-9422b9c79284 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.168881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1186/2380] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:03:34.173442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:34.186581 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02071db4-d421-4935-97ff-5c35ac606394 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.194070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.195068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.195343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.195609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] PATH_INFO: `/v3/projects/fbb73cbdaf7b4426a12840fe60219edf/users/9e125dd68e954ab68774789ba58b52a5/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.213469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb73cbdaf7b4426a12840fe60219edf, user_id=9e125dd68e954ab68774789ba58b52a5, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.216478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.232778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1195/2381] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:03:34 2021] PUT /identity/v3/projects/fbb73cbdaf7b4426a12840fe60219edf/users/9e125dd68e954ab68774789ba58b52a5/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:03:34.247818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.247818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.248063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.279576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] MFA Rules not processed for user `9e125dd68e954ab68774789ba58b52a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:03:34.280848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:34.334775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:34.341850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:34.358702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1187/2382] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:03:34 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:03:34.372585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:34.374116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:34.414617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eb518-a125-4074-902c-65d437a855f1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.419731 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.420636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.420913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.421197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] PATH_INFO: `/v3/projects/65d800b461854d12b3c94a486da8922c` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.423139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d800b461854d12b3c94a486da8922c)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.425072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.455623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80662f-647c-4ec5-9e4f-df058ec1c6ad None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:34.459788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:34.460439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:34.460722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:34.460984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:34.469863 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:34.471457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:34.474646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d800b461854d12b3c94a486da8922c', 'request_id': 'req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:34.481408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1188/2383] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:34 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:03:34.483552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d800b461854d12b3c94a486da8922c', 'request_id': 'req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:34.489608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d800b461854d12b3c94a486da8922c', 'request_id': 'req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:34.502309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] The token cache is being invalidate because project 65d800b461854d12b3c94a486da8922c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:03:34.502628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:34.503304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:03:34.505107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1196/2384] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:03:34 2021] DELETE /identity/v3/projects/65d800b461854d12b3c94a486da8922c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:03:35.564333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:35.566072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:35.656964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287f45a-de3c-41ce-9550-e6f18067d1ce service glance] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:35.724790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:35.725459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:35.725740 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:35.726012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:35.728082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:35.741562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:35.743229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:35.755797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1189/2385] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:03:50.461590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:03:50.463464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:50.545713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0b88-c9f6-49d9-9085-f5c6b7214225 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:03:50.551979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:03:50.552624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:03:50.552910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:03:50.553201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:03:50.555365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:03:50.569762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:03:50.572340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:03:50.586987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1197/2386] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:03:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:04:56.997474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:04:56.999075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:04:57.064133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58c81-f850-4c61-b96f-c013456013a0 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:04:57.068721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:04:57.069387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:04:57.069718 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:04:57.069995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:04:57.072175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:04:57.162066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:04:57.163563 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:04:57.183182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1190/2387] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:04:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:04:57.506000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:04:57.516345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dab1-3580-4cf3-97af-7a99afe0abea service placement] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:04:57.521649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:04:57.522353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:04:57.522639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:04:57.522916 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:04:57.525051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:04:57.620540 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:04:57.622030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:04:57.641637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1198/2388] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:04:57 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:05:47.386560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:05:47.396595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3fddf-522f-4f00-99b7-577a51080385 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:05:47.400955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:05:47.401599 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:05:47.401879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:05:47.402181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:05:47.404237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:05:47.491028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:05:47.492815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:05:47.503454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1191/2389] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:05:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:05:56.747989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:05:56.749533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:05:56.810428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36777184-151f-4882-b02c-50d2643037e7 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:05:56.814626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:05:56.815261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:05:56.815538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:05:56.815808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:05:56.817926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:05:56.828768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:05:56.830266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:05:56.838993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1199/2390] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:05:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:06:14.228410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:06:14.237749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312a1a-5444-4db3-bddc-cd87142209a1 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:06:14.242513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:06:14.243173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:06:14.243521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:06:14.243763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:06:14.245927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:06:14.333088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:06:14.334567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:06:14.343631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1192/2391] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:06:14 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:08:35.325294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:08:35.345213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0f95d-ebee-403e-a151-6f78314270f5 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:08:35.349186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:08:35.349824 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:08:35.350100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:08:35.350403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:08:35.352214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:08:35.446131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:08:35.447653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:08:35.457170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1200/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:08:35 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:08:57.472190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:08:57.473781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:08:57.563638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0b2c-cf61-4e86-990f-13cc7fa5595d service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:08:57.570571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:08:57.571239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:08:57.571648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:08:57.572040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:08:57.582434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:08:57.584027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:08:57.594711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1193/2393] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:08:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:09:24.225133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:09:24.246017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4825f5-d6a8-4372-956e-1f3d86d408e9 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:09:24.250767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:09:24.251409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:09:24.251690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:09:24.251979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:09:24.254046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:09:24.289453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:09:24.290920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:09:24.311634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1201/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:09:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:09:25.519395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:09:25.534937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d047b-4ad1-4e69-a2c9-7b1717dfaa63 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:09:25.538931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:09:25.539568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:09:25.539846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:09:25.540118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:09:25.542307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:09:25.556377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:09:25.557801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:09:25.569387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1194/2395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:09:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:09:56.017012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:09:56.028058 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806c5af-9cd5-4c2a-9b7c-feb786f3ca60 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:09:56.032770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:09:56.033451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:09:56.033736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:09:56.034010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:09:56.044208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:09:56.045702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:09:56.055217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1202/2396] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:09:56 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:09:56.674517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:09:56.686594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011890f-478d-4713-b262-707de4f3cf3e service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:09:56.692229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c81107-528a-4b23-81a9-32922bab1ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:09:56.692872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81107-528a-4b23-81a9-32922bab1ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:09:56.693195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81107-528a-4b23-81a9-32922bab1ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:09:56.693475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81107-528a-4b23-81a9-32922bab1ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:09:56.705568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c81107-528a-4b23-81a9-32922bab1ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:09:56.707391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c81107-528a-4b23-81a9-32922bab1ed9 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:09:56.717889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1195/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:09:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:10:19.450904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:10:19.454040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:10:19.498886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001bb00-f169-4d2b-9215-9890dbd395bd service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:10:19.505596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:10:19.506594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:10:19.507199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:10:19.507629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:10:19.509906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:10:19.527983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:10:19.530307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:10:19.552823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1203/2398] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:10:19 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:10:21.894868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:10:21.895476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:10:21.895476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:10:21.926098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] MFA Rules not processed for user `d50d9103fa7d4f74bd77defac782f225`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:10:21.927378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:10:21.943161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1196/2399] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:10:21 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:10:22.203817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:10:22.215457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93866474-ccb3-44ef-8db3-ee347080b9d5 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:10:22.220320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:10:22.221124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:10:22.221263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:10:22.221548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:10:22.223716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:10:22.247317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:10:22.248565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:10:22.256880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1204/2400] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:10:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:10:22.595610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:10:22.607594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215d8bd-7044-4df4-ae54-a1472563e26f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:10:22.613326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:10:22.613978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:10:22.614296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:10:22.614569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:10:22.616375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:10:22.628896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:10:22.630537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:10:22.640798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1197/2401] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:10:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:10:31.621092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:10:31.635347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cb88-677c-4550-ad17-6b056deced7b service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:10:31.642487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:10:31.643527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:10:31.643810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:10:31.644084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:10:31.654018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:10:31.655670 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:10:31.666915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1205/2402] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:10:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:10:47.267315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:10:47.280952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bc0f-972f-45d4-afd9-ab027901f293 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:10:47.285561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:10:47.286205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:10:47.286505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:10:47.286779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:10:47.295851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:10:47.297278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:10:47.306431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1198/2403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:10:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:11:15.193852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:11:15.196427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:11:15.212756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27206367-253f-415c-8688-b477a65fbcd6 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:11:15.220222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:11:15.220875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:11:15.221151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:11:15.221423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:11:15.230521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:11:15.232145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:11:15.252480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1206/2404] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:11:15 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:12:01.100448 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:12:01.117355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf193b0-058b-4cb4-89ba-e88e91590b0a service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:12:01.122515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:12:01.123154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:12:01.123432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:12:01.123695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:12:01.132513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:12:01.134121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:12:01.143607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1199/2405] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:12:01 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:13:35.200013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:13:35.201530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:13:35.235961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01722d9-a06d-4242-baa7-d941b7ebd002 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:13:35.240822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:13:35.241500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:13:35.241788 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:13:35.242037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:13:35.251922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:13:35.253398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:13:35.282451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1207/2406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:13:35 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:14:00.461330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:14:00.534838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0dc8-dacb-4269-a00a-896fd3a007de service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:14:00.540858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:14:00.541518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:14:00.541804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:14:00.542091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:14:00.544201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:14:00.556184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:14:00.557851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:14:00.567695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1200/2407] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:14:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:14:23.334517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:14:23.344191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdebe8-939b-448b-bba6-81eca52bbd02 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:14:23.348721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:14:23.349344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:14:23.349623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:14:23.349898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:14:23.421311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:14:23.422812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:14:23.433894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1208/2408] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:14:23 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:14:24.619164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:14:24.629846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7050-2ad4-45fc-9fd1-aef5af1e729c service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:14:24.634277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:14:24.634945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:14:24.635249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:14:24.635530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:14:24.647070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:14:24.648476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:14:24.659496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1201/2409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:14:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:14:56.668136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:14:56.679057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727d7d-a363-4504-a3a3-9f71c741603a service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:14:56.683371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:14:56.684125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:14:56.684411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:14:56.684685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:14:56.694596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:14:56.696225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:14:56.706656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1209/2410] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:14:56 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:14:56.830450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:14:56.840308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6ba2a-0333-4b5b-9739-6a9afd3a3eb7 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:14:56.844472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddfae5-1f1f-4bb3-af6f-780c5c22f89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:14:56.845114 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddfae5-1f1f-4bb3-af6f-780c5c22f89d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:14:56.845396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddfae5-1f1f-4bb3-af6f-780c5c22f89d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:14:56.845671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddfae5-1f1f-4bb3-af6f-780c5c22f89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:14:56.854889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddfae5-1f1f-4bb3-af6f-780c5c22f89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:14:56.856324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddfae5-1f1f-4bb3-af6f-780c5c22f89d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:14:56.865917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1202/2411] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:14:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:15:35.145495 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:35.147225 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:35.275054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5827-971f-432e-8911-49c961acdfc7 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:35.283228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:35.284983 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:35.285265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:35.285654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] PATH_INFO: `/v3/users/9e125dd68e954ab68774789ba58b52a5` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:35.308151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e125dd68e954ab68774789ba58b52a5)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:35.311213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:35.383066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e125dd68e954ab68774789ba58b52a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:35.384691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e125dd68e954ab68774789ba58b52a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:35.384691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e125dd68e954ab68774789ba58b52a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:35.395406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e125dd68e954ab68774789ba58b52a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:35.409867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e125dd68e954ab68774789ba58b52a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:35.424620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1210/2412] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:15:35 2021] DELETE /identity/v3/users/9e125dd68e954ab68774789ba58b52a5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:15:35.429386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:35.429938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:35.429938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:35.470407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:15:35.471703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:35.552236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1203/2413] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:15:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:15:35.565464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:35.567733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:35.637133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5a5c-fd02-4d84-993b-87c0ca49dfae admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:35.641359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c541486-3c5b-4a1b-9560-104531f86a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:35.642139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c541486-3c5b-4a1b-9560-104531f86a26 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:35.642822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c541486-3c5b-4a1b-9560-104531f86a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:35.643179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c541486-3c5b-4a1b-9560-104531f86a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:35.655967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c541486-3c5b-4a1b-9560-104531f86a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:35.657435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c541486-3c5b-4a1b-9560-104531f86a26 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:35.668994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1211/2414] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:15:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:15:36.005378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.007651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:36.025486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69fce-cbf7-4795-b426-8cef4fac93bf None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.030842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.031780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.032261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.033012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] PATH_INFO: `/v3/projects/fbb73cbdaf7b4426a12840fe60219edf` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.035117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb73cbdaf7b4426a12840fe60219edf)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.037987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.101535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb73cbdaf7b4426a12840fe60219edf', 'request_id': 'req-a3d72441-8c8a-4063-a165-742909fa6af8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:36.110327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb73cbdaf7b4426a12840fe60219edf', 'request_id': 'req-a3d72441-8c8a-4063-a165-742909fa6af8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:36.121339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb73cbdaf7b4426a12840fe60219edf', 'request_id': 'req-a3d72441-8c8a-4063-a165-742909fa6af8'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:36.129806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] The token cache is being invalidate because project fbb73cbdaf7b4426a12840fe60219edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:15:36.130021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:36.130698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a3d72441-8c8a-4063-a165-742909fa6af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:15:36.132508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1204/2415] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:15:36 2021] DELETE /identity/v3/projects/fbb73cbdaf7b4426a12840fe60219edf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:15:36.141575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.141974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.142906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.201388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:15:36.202563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:36.271717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1212/2416] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:15:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:15:36.279766 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.280078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.280350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.300332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:15:36.301571 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:36.311165 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1205/2417] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:15:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:15:36.315863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.330915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f010b8e-cc3b-489b-8b82-868f8d37aa71 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.337210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.337862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.338140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.338433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.339181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:15:36.339485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.341096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.353532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1213/2418] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:15:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:15:36.359864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.370300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539dc1e-e549-47bf-bfdf-ea07094932b3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.376827 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.377787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.378339 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.378488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.379174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.381537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.425065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1206/2419] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:15:36 2021] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:15:36.431246 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.446398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0749813-8aa1-4552-8bbd-71aee9e61094 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.507350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.508036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.508323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.508599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.509349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.511368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.533183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1214/2420] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:15:36 2021] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:15:36.537366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.549679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff6a0e-b169-4f7c-a9a0-f519eef273d2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.556475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.557145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.557423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.557693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.558470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.560079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.574757 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1207/2421] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:15:36.579940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.593184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3e22-df5d-4fc0-b1aa-3a8b9057abd0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.601112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637fe55-9fdb-476b-848f-2a362f784782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.602036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637fe55-9fdb-476b-848f-2a362f784782 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.602454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637fe55-9fdb-476b-848f-2a362f784782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.602829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637fe55-9fdb-476b-848f-2a362f784782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.603998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637fe55-9fdb-476b-848f-2a362f784782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.606463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637fe55-9fdb-476b-848f-2a362f784782 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.618576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1215/2422] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:15:36.622884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.634452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501d83-ed4a-463c-822f-75faf17a2bee admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.641087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.642024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.642343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.642625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] PATH_INFO: `/v3/projects/4ef0c57403064aeaab8d7e52f63a1dbe/users/22a57f3470804e429912e89c63230b72/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.660064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef0c57403064aeaab8d7e52f63a1dbe, user_id=22a57f3470804e429912e89c63230b72, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.662752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.678525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1208/2423] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:15:36 2021] PUT /identity/v3/projects/4ef0c57403064aeaab8d7e52f63a1dbe/users/22a57f3470804e429912e89c63230b72/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:15:36.689417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.689706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.689982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.718804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] MFA Rules not processed for user `22a57f3470804e429912e89c63230b72`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:15:36.720095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:36.796936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1216/2424] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:15:36 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:15:36.855345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:36.858120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:36.936456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56b1ff-1704-44d2-b2bd-f49429574fec admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:36.941049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:36.941710 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:36.941975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:36.942279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:36.951838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:36.953277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:36.962933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1209/2425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:15:36 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:15:47.803484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:15:47.815359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9317e1-47b4-4b6d-ad1b-2e8b76401626 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:15:47.820053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:15:47.820726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:15:47.821020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:15:47.821409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:15:47.823718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:15:47.914988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:15:47.917353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:15:47.931860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1217/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:15:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:16:15.449190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:16:15.459190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ead88-6904-4e3d-985c-d0fbaa578d42 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:16:15.463848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:16:15.464511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:16:15.464827 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:16:15.465477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:16:15.467617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:16:15.555105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:16:15.556469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:16:15.566082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1210/2427] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:16:15 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:17:07.084730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:17:07.086264 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:17:07.162822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1664-a29f-45a5-90a9-d3b5a44aceff service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:17:07.169155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:17:07.170096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:17:07.170415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:17:07.170695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:17:07.172746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:17:07.183711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:17:07.185171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:17:07.194279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1218/2428] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:17:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:19:05.397451 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:19:05.399960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:19:05.557589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ed25-1e62-4b3b-9e48-7c0c2d947fad service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:19:05.564191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:19:05.564857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:19:05.565142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:19:05.565426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:19:05.567675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:19:05.579625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:19:05.581197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:19:05.590834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1211/2429] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:19:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:19:56.805147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:19:56.827176 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd12fe8-b774-4ecd-b520-e0235c30e20e service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:19:56.831403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:19:56.832049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:19:56.832333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:19:56.832613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:19:56.834944 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:19:56.926101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:19:56.927546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:19:56.948906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1219/2430] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:19:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:19:56.991945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:19:57.002133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63702ebd-3430-48d8-99aa-c16ef48d9458 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:19:57.007134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:19:57.007775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:19:57.008027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:19:57.008315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:19:57.010507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:19:57.105122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:19:57.106642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:19:57.127918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1212/2431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:19:56 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:20:36.829778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:20:36.832467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:20:36.850741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edae44-dada-4f9c-9d0d-6ca5caca81af service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:20:36.855586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:20:36.856196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:20:36.856512 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:20:36.856785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:20:36.866735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:20:36.868192 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:20:36.877251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1220/2432] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:20:36 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:20:48.494395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:20:48.503429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1d1c6-9b37-4e99-85b6-4f2cee5c383b service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:20:48.508901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:20:48.509866 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:20:48.510246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:20:48.510591 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:20:48.523842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:20:48.526043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:20:48.547162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1213/2433] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:20:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:21:15.984634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:15.993780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55ca7-0433-4d43-bc67-7fb42be043f2 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:15.999072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c1648-223a-4676-abb9-6225162307ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:15.999703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1648-223a-4676-abb9-6225162307ee service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:15.999980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1648-223a-4676-abb9-6225162307ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:16.000248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1648-223a-4676-abb9-6225162307ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:16.010787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c1648-223a-4676-abb9-6225162307ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:16.012226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c1648-223a-4676-abb9-6225162307ee service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:16.031741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1221/2434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:21:15 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:21:38.109249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:38.178861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46920f-93ca-4f15-8724-b760241a648d service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:38.183543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:38.184429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:38.184709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:38.184983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] PATH_INFO: `/v3/users/22a57f3470804e429912e89c63230b72` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:38.186222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a57f3470804e429912e89c63230b72)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:38.188146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:38.245814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a57f3470804e429912e89c63230b72'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.246505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a57f3470804e429912e89c63230b72'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.247634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a57f3470804e429912e89c63230b72'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.256693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a57f3470804e429912e89c63230b72'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.269282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a57f3470804e429912e89c63230b72'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.281552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1214/2435] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:21:38 2021] DELETE /identity/v3/users/22a57f3470804e429912e89c63230b72 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:21:38.287247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:38.287780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:38.287780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:38.311238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:21:38.312447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:38.375144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1222/2436] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:21:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:21:38.387131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:38.394515 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:38.470287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d9f9-8d69-4ac7-9001-079ba36dcf39 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:38.475632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:38.476474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:38.476862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:38.477174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:38.487631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:38.489057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:38.500395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1215/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:21:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:21:38.577785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:38.579460 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:38.592643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00798-c10a-4b2c-a269-1b3cf3d334a3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:38.596442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:38.597138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:38.597421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:38.597697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:38.599759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:38.694622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:38.696128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:38.716072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1223/2438] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:21:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:21:38.824975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:38.826594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:38.840155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043600-70ae-47d0-8b7e-99536323962b service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:38.845311 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:38.846359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:38.846640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:38.846914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] PATH_INFO: `/v3/projects/4ef0c57403064aeaab8d7e52f63a1dbe` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:38.848229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef0c57403064aeaab8d7e52f63a1dbe)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:38.850258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:38.923724 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef0c57403064aeaab8d7e52f63a1dbe', 'request_id': 'req-d643ccb5-9019-41ad-8ed5-d8a572676638'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.931844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef0c57403064aeaab8d7e52f63a1dbe', 'request_id': 'req-d643ccb5-9019-41ad-8ed5-d8a572676638'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.937316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef0c57403064aeaab8d7e52f63a1dbe', 'request_id': 'req-d643ccb5-9019-41ad-8ed5-d8a572676638'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.948676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] The token cache is being invalidate because project 4ef0c57403064aeaab8d7e52f63a1dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:21:38.948966 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.949691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:21:38.951392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1216/2439] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:21:38 2021] DELETE /identity/v3/projects/4ef0c57403064aeaab8d7e52f63a1dbe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:21:39.585359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:39.587773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:39.602358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4ba7-033a-4784-b3ac-b85ce4fec639 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:39.671575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:39.672140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:39.672417 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:39.672687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:39.674765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:39.686564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:39.688451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:39.699524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1224/2440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:21:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:21:41.266340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:21:41.268094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:41.332288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643ccb5-9019-41ad-8ed5-d8a572676638 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:21:41.336167 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:21:41.336837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:21:41.337119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:21:41.337395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:21:41.339356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:21:41.353989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:21:41.355484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:21:41.367378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1217/2441] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:21:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:22:12.080404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:12.092532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93749a-6c10-49a4-825f-3d5dbf8805b1 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:12.097910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:12.098619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:12.098943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:12.099221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:12.101606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:12.112399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:12.113872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:12.122502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1225/2442] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:22:22.640489 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:22.653587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d803-449e-4b04-9981-3283770aad50 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:22.660199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:22.661133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:22.661546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:22.661954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:22.665185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:22.734511 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:22.735953 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:22.746011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1218/2443] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:22:26.526313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:26.528120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:26.545474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e597d28-c81a-4cce-992d-8b84502bdbb3 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:26.551166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:26.552139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:26.552416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:26.552684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] PATH_INFO: `/v3/users/9f70acf2d84d44c896f1d284b84fa9d4` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:26.554030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f70acf2d84d44c896f1d284b84fa9d4)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:26.556020 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:26.612338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f70acf2d84d44c896f1d284b84fa9d4'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.613008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f70acf2d84d44c896f1d284b84fa9d4'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.613653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f70acf2d84d44c896f1d284b84fa9d4'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.623216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f70acf2d84d44c896f1d284b84fa9d4'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.635966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-defb00a1-ebac-4b55-af17-ff55978789b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f70acf2d84d44c896f1d284b84fa9d4'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.648314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1226/2444] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:22:26 2021] DELETE /identity/v3/users/9f70acf2d84d44c896f1d284b84fa9d4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:22:26.843081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:26.853296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3f51b-7043-40ce-897b-90635ce3b728 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:26.914677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:26.915539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:26.915817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:26.916085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] PATH_INFO: `/v3/projects/d0b05ad418584ca19686c99ea57da374` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:26.917366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b05ad418584ca19686c99ea57da374)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:26.919316 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:26.970821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b05ad418584ca19686c99ea57da374', 'request_id': 'req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.980066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b05ad418584ca19686c99ea57da374', 'request_id': 'req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.986087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b05ad418584ca19686c99ea57da374', 'request_id': 'req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.997570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] The token cache is being invalidate because project d0b05ad418584ca19686c99ea57da374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:22:26.997826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:26.998506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-121b308c-76f5-46d0-8d7a-2658e5e8a8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:22:27.000064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1219/2445] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:22:26 2021] DELETE /identity/v3/projects/d0b05ad418584ca19686c99ea57da374 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:22:27.008070 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.008515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.008917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.030500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:22:27.031749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:27.099227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1227/2446] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:22:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:22:27.106820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.107150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.107435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.127666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:22:27.129531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:27.139442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1220/2447] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:22:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:22:27.144021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.155294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6500a-a130-45d3-bb29-d0c9e2504fb5 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.162359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.163061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.163340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.164067 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.164375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:22:27.164681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.168092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.181180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1228/2448] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:22:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:22:27.186259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.196313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c36869-bfe7-47ee-8e70-cfcd95869fb3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.201174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.201970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.202282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.202583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.203297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.205373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.235442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1221/2449] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:22:27 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:22:27.239281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.250140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a84bf-0b45-4736-a1e3-aceb9f3952d9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.304914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.305657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.305935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.306312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.307025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.308886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.331223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1229/2450] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:22:27 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:22:27.336294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.349136 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e87953-15f4-47d9-bc55-d92aca01d650 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.354943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.355614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.355895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.356170 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.357107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.358816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.369578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1222/2451] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:22:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:22:27.374730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.391378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8d62c-650b-41d0-b2cd-9d8e90d8fe94 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.398968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602b75c-ba62-4f15-bdc2-35262c902f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.399641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b75c-ba62-4f15-bdc2-35262c902f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.399919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b75c-ba62-4f15-bdc2-35262c902f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.402227 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602b75c-ba62-4f15-bdc2-35262c902f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.404321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602b75c-ba62-4f15-bdc2-35262c902f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.406846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602b75c-ba62-4f15-bdc2-35262c902f04 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.420028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1230/2452] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:22:27 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:22:27.430302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.442811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af79f9-d5fa-400c-ab3c-106448651253 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.448475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.449357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.449632 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.449903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] PATH_INFO: `/v3/projects/9f86f93bf80849ffadb5e07891102ce5/users/b865802b111a42118b385d68fb89f352/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.465347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f86f93bf80849ffadb5e07891102ce5, user_id=b865802b111a42118b385d68fb89f352, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.468315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.485624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1223/2453] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:22:27 2021] PUT /identity/v3/projects/9f86f93bf80849ffadb5e07891102ce5/users/b865802b111a42118b385d68fb89f352/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:22:27.491143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49bdd-25cc-4851-926a-8242d815793d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.491428 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49bdd-25cc-4851-926a-8242d815793d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.491706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49bdd-25cc-4851-926a-8242d815793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.510961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d3a49bdd-25cc-4851-926a-8242d815793d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:22:27.512182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3a49bdd-25cc-4851-926a-8242d815793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:27.575498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1231/2454] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:22:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:22:27.589717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:27.592341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:27.651782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ddc59-7fa1-4991-98da-d0e28ffa5a89 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:27.655899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:27.656564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:27.656846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:27.657125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:27.666574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:27.668028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:27.677586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1224/2455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:22:31.724866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6ad8-792a-452d-8dd1-c21dc9d6d219 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:31.725388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6ad8-792a-452d-8dd1-c21dc9d6d219 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:31.725503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6ad8-792a-452d-8dd1-c21dc9d6d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:31.755926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f33e6ad8-792a-452d-8dd1-c21dc9d6d219 None None] MFA Rules not processed for user `b865802b111a42118b385d68fb89f352`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:22:31.757202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f33e6ad8-792a-452d-8dd1-c21dc9d6d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:31.832319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1232/2456] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:22:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:22:31.840395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:31.848227 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:31.928071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98d08-5a2b-4c4f-91cf-558c25763904 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:31.933772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:31.934483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:31.934770 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:31.935303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:31.943794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:31.945467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:31.955127 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1225/2457] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:22:33.703266 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:33.703793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:33.703938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:33.723183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] MFA Rules not processed for user `b865802b111a42118b385d68fb89f352`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:22:33.724407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:33.732233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1233/2458] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:22:33 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:22:34.087078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:34.097034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780763dc-bebe-4b64-ad57-309cacf9b6a6 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:34.101355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:34.102003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:34.102323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:34.102639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:34.104527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:34.114375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:34.116144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:34.124581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1226/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:22:34.487643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:34.489059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:34.605397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac861cf-3125-4a4b-ae51-48f346b9a1f4 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:34.610962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:34.611843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:34.612142 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:34.612424 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:34.619965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:34.634942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:34.636848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:34.663833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1234/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:22:41.600641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:22:41.602109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:41.620134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01af3a-6729-40f7-a016-c073c58437a4 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:22:41.626661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:22:41.627336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:22:41.627900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:22:41.628170 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:22:41.630266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:22:41.643059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:22:41.644850 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:22:41.656938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1227/2461] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:22:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:24:12.421794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:24:12.435876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab5384-1a1c-4811-8b3d-7840f7bc247e service placement] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:24:12.442738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:24:12.443620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:24:12.443935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:24:12.444263 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:24:12.446878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:24:12.459646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:24:12.461236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:24:12.471487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1235/2462] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:24:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:24:57.060124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:24:57.072924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d8612-cea6-4eb2-ae90-6a27cd1c81f5 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:24:57.080892 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:24:57.081529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:24:57.081805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:24:57.082074 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:24:57.084257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:24:57.161277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:24:57.162919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:24:57.176539 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1228/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:24:57 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:26:22.721726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:26:22.723418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:26:22.814914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b59a7-be96-4601-8e77-2e6e3fcac2fc service placement] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:26:22.819528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:26:22.820183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:26:22.820511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:26:22.820801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:26:22.822982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:26:22.905427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:26:22.906862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:26:22.915808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1236/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:26:22 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:26:23.013025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:26:23.022435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a59cf4-6e91-439d-af4d-442a671c31af service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:26:23.026549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:26:23.027163 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:26:23.027529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:26:23.027810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:26:23.029728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:26:23.108782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:26:23.110274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:26:23.119877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1229/2465] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:26:23 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:26:38.287258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:26:38.298387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefb5e4-77f1-468d-bad0-6bd0355b5640 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:26:38.303473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:26:38.304125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:26:38.304402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:26:38.304667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:26:38.307119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:26:38.322753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:26:38.324201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:26:38.336172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1237/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:26:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:26:41.670229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:26:41.680819 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcedc93-6844-4db9-b8d0-384b1eb9dbeb service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:26:41.687290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:26:41.688116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:26:41.688425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:26:41.688772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:26:41.692020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:26:41.709749 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:26:41.711228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:26:41.723140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1230/2467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:26:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:27:19.063191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:19.075102 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000e9f-46f9-4487-baf1-1d217ecaf618 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:19.080179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:19.080826 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:19.081139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:19.081411 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:19.083851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:19.094612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:19.096060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:19.104146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1238/2468] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:27:19 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:27:41.863967 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:41.873633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8504-c91b-4e23-8256-6e9569551b14 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:41.878310 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:41.878979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:41.879256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:41.879562 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:41.881714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:41.918191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:41.919675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:41.938972 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1231/2469] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:27:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:27:42.966839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:42.968379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:42.979988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dffdb-585c-4887-8dea-f16af45a7091 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:42.983726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:42.984446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:42.984733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:42.985009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:42.993751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:42.995253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:43.004852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1239/2470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:27:42 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:27:44.676147 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:44.677662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:44.690456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec83a-a426-4d00-a29e-1aa92cbdc855 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:44.695332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:44.696446 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:44.696977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:44.697109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] PATH_INFO: `/v3/users/ed271ee2a33f484ebb184fd30f99281b` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:44.698503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed271ee2a33f484ebb184fd30f99281b)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:44.700544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:44.750321 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed271ee2a33f484ebb184fd30f99281b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:44.750961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed271ee2a33f484ebb184fd30f99281b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:44.751549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed271ee2a33f484ebb184fd30f99281b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:44.759537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed271ee2a33f484ebb184fd30f99281b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:44.771738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-081c8ce6-710c-4040-b99f-86a99346aaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed271ee2a33f484ebb184fd30f99281b'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:44.786053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1232/2471] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:27:44 2021] DELETE /identity/v3/users/ed271ee2a33f484ebb184fd30f99281b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:27:44.974887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:44.986480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c2d98-1574-4b7f-9f7c-1c23dddc33aa service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.046137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.046967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.047249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.047509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] PATH_INFO: `/v3/projects/f5c60a77a9e14defb1cbca4e34871865` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.048893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c60a77a9e14defb1cbca4e34871865)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.050977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.102295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c60a77a9e14defb1cbca4e34871865', 'request_id': 'req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:45.112623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c60a77a9e14defb1cbca4e34871865', 'request_id': 'req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:45.118933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c60a77a9e14defb1cbca4e34871865', 'request_id': 'req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:45.131088 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] The token cache is being invalidate because project f5c60a77a9e14defb1cbca4e34871865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:27:45.131304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:45.131979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-6aa5b3a9-9715-44d8-aa35-2cd7de67cc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:27:45.133597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1240/2472] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:27:44 2021] DELETE /identity/v3/projects/f5c60a77a9e14defb1cbca4e34871865 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:27:45.146904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.147187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.147460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.204603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:27:45.205826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:45.274946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1233/2473] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:27:45.277112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.277430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.277760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.297934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:27:45.299124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:45.308059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1241/2474] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:27:45.312512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.322982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30c881-de0c-4058-af91-411847b6f914 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.328318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.329175 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.329459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.329736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.330565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:27:45.330871 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.332491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.347427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1234/2475] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:27:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:27:45.349154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.358964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aa609-160e-492b-9fc0-949fe4e5ed02 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.364091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.364766 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.365047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.365321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.366046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.367994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.405687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1242/2476] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:27:45.409954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.420796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db6dc-25ac-48e4-ab7b-9ad6abd3bdea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.484463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.485401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.485705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.486069 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.487186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.490054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.512510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1235/2477] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:27:45.517395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.530971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0d2f8-0748-441e-8395-45b9e99a704b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.536514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.537197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.537480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.537752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.538585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.540223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.550937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1243/2478] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:27:45.555080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.565785 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f4df-7055-4769-ae30-05957bff68b4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.571113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa35bc-b30b-4e92-9852-055e8d1367d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.571957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa35bc-b30b-4e92-9852-055e8d1367d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.572284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa35bc-b30b-4e92-9852-055e8d1367d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.572598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa35bc-b30b-4e92-9852-055e8d1367d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.573348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa35bc-b30b-4e92-9852-055e8d1367d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.575001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa35bc-b30b-4e92-9852-055e8d1367d6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.585746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1236/2479] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:27:45.590302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.600930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712ff7b-49c6-434a-8390-6e6580a72ef6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.606843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.607744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.608026 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.608303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] PATH_INFO: `/v3/projects/44cd938c67844110a736427a035826da/users/a1f1be6776874e82b3f6189ca43c7947/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.623976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44cd938c67844110a736427a035826da, user_id=a1f1be6776874e82b3f6189ca43c7947, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.626724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.642947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1244/2480] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:27:45 2021] PUT /identity/v3/projects/44cd938c67844110a736427a035826da/users/a1f1be6776874e82b3f6189ca43c7947/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:27:45.653810 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.654109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.654431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.683780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] MFA Rules not processed for user `a1f1be6776874e82b3f6189ca43c7947`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:27:45.685663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:45.760969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1237/2481] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:27:45.765730 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.831527 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe989cc4-d44e-4f3a-863f-81a4f11a7435 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.839908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.840790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.841171 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.841474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.842629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.845697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.878860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1245/2482] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:27:45.884641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:45.895612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc916d0-f32e-4fd9-a169-4d1a9f3f6e81 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:45.953407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:45.954340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:45.954712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:45.955065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:45.956174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:45.959201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:45.985466 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1238/2483] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:27:45 2021] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:27:45.989611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:46.001018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919d33-6062-49a3-a268-3a7a477b5b18 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:46.006796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:46.007476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:46.007751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:46.008018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:46.008768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:46.010454 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:46.021496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1246/2484] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:27:46.026022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:46.036784 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8a182-31aa-4931-91a5-7684dcf1a351 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:46.042942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:46.043903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:46.044179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:46.044461 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] PATH_INFO: `/v3/projects/ecbde323772e42f58619c820e751b834/users/2de7cb966be04362b92b50c134f6af91/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:46.061930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbde323772e42f58619c820e751b834, user_id=2de7cb966be04362b92b50c134f6af91, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:46.064663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:46.080903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1239/2485] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:27:46 2021] PUT /identity/v3/projects/ecbde323772e42f58619c820e751b834/users/2de7cb966be04362b92b50c134f6af91/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:27:46.085078 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:46.095472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656dc46-1757-40bf-929c-e5c433d30a9a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:46.161737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1ec85-0156-45d5-aeed-6b5ac4f9f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:46.162447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1ec85-0156-45d5-aeed-6b5ac4f9f482 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:46.162727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1ec85-0156-45d5-aeed-6b5ac4f9f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:46.162994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1ec85-0156-45d5-aeed-6b5ac4f9f482 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:46.163771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1ec85-0156-45d5-aeed-6b5ac4f9f482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:46.165415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1ec85-0156-45d5-aeed-6b5ac4f9f482 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:46.176034 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1247/2486] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:27:46.180500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:27:46.191795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e0217-79a8-4e8c-9c4d-44fc3031cfc6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:27:46.198042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:27:46.198970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:46.199251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:46.199517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] PATH_INFO: `/v3/projects/ecbde323772e42f58619c820e751b834/users/2de7cb966be04362b92b50c134f6af91/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:46.201799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbde323772e42f58619c820e751b834, user_id=2de7cb966be04362b92b50c134f6af91, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:27:46.204582 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:27:46.216370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1240/2487] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:27:46 2021] PUT /identity/v3/projects/ecbde323772e42f58619c820e751b834/users/2de7cb966be04362b92b50c134f6af91/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:27:46.226884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:27:46.227128 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:27:46.227464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:27:46.256504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] MFA Rules not processed for user `2de7cb966be04362b92b50c134f6af91`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:27:46.257727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:27:46.330917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1248/2488] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:27:46 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:23.517215 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:23.519322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:23.579507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39230f-2861-4a10-b870-554195925839 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:23.583727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:23.584405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:23.584683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:23.584955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:23.594798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:23.596277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:23.606932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1241/2489] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:23 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:27.855239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:27.856882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:27.870687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e954153-2e7b-4944-bc07-5c1d877fcf0c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:27.874960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:27.875682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:27.875964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:27.876244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:27.936448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:27.937936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:27.947002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1249/2490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:27 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:28.062412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:28.064947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:28.186500 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3355e-acc1-46ed-b9af-9abbf2dc4183 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:28.192664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:28.193405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:28.193797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:28.194122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:28.196418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:28.210653 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: WARNING keystone.server.flask.application [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] Could not find project: fbb73cbdaf7b4426a12840fe60219edf.: keystone.exception.ProjectNotFound: Could not find project: fbb73cbdaf7b4426a12840fe60219edf. Nov 10 16:28:28.213563 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1242/2491] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:28 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 10 16:28:29.489184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:29.490547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:29.568515 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec602-30ce-4e34-bb33-155c88a68314 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:29.574470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:29.575160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:29.575439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:29.575738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:29.577711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:29.591255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:29.592970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a4613-9aae-4e3e-8567-04c95fbfb00b service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:29.603922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1250/2492] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:28:30.714568 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:30.782697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b0d6-b21c-4926-8dfa-6bf0754e1b75 service glance] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:30.787996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:30.788883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:30.789161 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:30.789419 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] PATH_INFO: `/v3/users/a1f1be6776874e82b3f6189ca43c7947` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:30.790706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f1be6776874e82b3f6189ca43c7947)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:30.793639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:30.844401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f1be6776874e82b3f6189ca43c7947'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:30.845246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f1be6776874e82b3f6189ca43c7947'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:30.846039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f1be6776874e82b3f6189ca43c7947'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:30.857735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f1be6776874e82b3f6189ca43c7947'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:30.869951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f1be6776874e82b3f6189ca43c7947'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:30.882005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1243/2493] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:30 2021] DELETE /identity/v3/users/a1f1be6776874e82b3f6189ca43c7947 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:30.887085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:30.887628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:30.887628 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:30.906076 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:30.907332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:30.969660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1251/2494] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:30.980631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:30.982200 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:31.040369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472528a-49ab-4835-b7fa-43cdc1bb19b7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:31.044369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:31.045025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:31.045306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:31.045583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:31.054895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:31.056366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:31.065703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1244/2495] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:31.336637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:31.338317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:31.350814 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd853-c9c2-4c1d-bac4-828b4616ad25 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:31.356496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:31.357394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:31.357676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:31.357949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] PATH_INFO: `/v3/projects/44cd938c67844110a736427a035826da` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:31.359335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44cd938c67844110a736427a035826da)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:31.361317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:31.411396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44cd938c67844110a736427a035826da', 'request_id': 'req-36976e60-0795-44e2-aa0f-49bb67971531'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.421063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44cd938c67844110a736427a035826da', 'request_id': 'req-36976e60-0795-44e2-aa0f-49bb67971531'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.429031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44cd938c67844110a736427a035826da', 'request_id': 'req-36976e60-0795-44e2-aa0f-49bb67971531'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.442510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] The token cache is being invalidate because project 44cd938c67844110a736427a035826da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:31.442800 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.443597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.445469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1252/2496] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:31 2021] DELETE /identity/v3/projects/44cd938c67844110a736427a035826da => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:31.450610 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:31.461350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6438e6d-7b4b-4e3c-9602-e797fdb035f8 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:31.521362 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:31.522285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:31.522566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:31.522840 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] PATH_INFO: `/v3/users/2de7cb966be04362b92b50c134f6af91` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:31.524071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de7cb966be04362b92b50c134f6af91)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:31.526070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:31.578209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de7cb966be04362b92b50c134f6af91'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.579294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de7cb966be04362b92b50c134f6af91'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.580398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de7cb966be04362b92b50c134f6af91'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.592633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de7cb966be04362b92b50c134f6af91'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.605779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-15d185b9-e9b5-43c8-94e7-4dd83681953c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de7cb966be04362b92b50c134f6af91'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:31.618830 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1245/2497] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:31 2021] DELETE /identity/v3/users/2de7cb966be04362b92b50c134f6af91 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:31.911068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:31.912606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:31.927992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36976e60-0795-44e2-aa0f-49bb67971531 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:31.984945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:31.985817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:31.986103 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:31.986418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] PATH_INFO: `/v3/projects/ecbde323772e42f58619c820e751b834` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:31.987635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbde323772e42f58619c820e751b834)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:31.989563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.041601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbde323772e42f58619c820e751b834', 'request_id': 'req-0790e027-cfcc-453a-80e1-342161fab6e3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:32.050932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbde323772e42f58619c820e751b834', 'request_id': 'req-0790e027-cfcc-453a-80e1-342161fab6e3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:32.056810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbde323772e42f58619c820e751b834', 'request_id': 'req-0790e027-cfcc-453a-80e1-342161fab6e3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:32.068311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] The token cache is being invalidate because project ecbde323772e42f58619c820e751b834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:32.068602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:32.069269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0790e027-cfcc-453a-80e1-342161fab6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:32.070941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1253/2498] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:31 2021] DELETE /identity/v3/projects/ecbde323772e42f58619c820e751b834 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:32.077341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.077902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.077902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.095946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:32.097160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:32.165423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1246/2499] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:32.175118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.175469 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.175813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.195631 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:32.196969 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:32.207722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1254/2500] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:32.214739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.222856 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db42e9-bc70-45a0-8806-a749f6ea7458 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.229101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.229780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.230060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.230387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.231428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:28:32.231746 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.233440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.246600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1247/2501] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:28:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:28:32.251304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.263439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2a9bd-f910-40a9-9848-26b9454c79b3 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.270030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.271079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.271443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.271817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.272867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.276269 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.305346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1255/2502] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:32.309829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.320258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585ba7-da33-41d7-8ee0-360f9f3db7a9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.380869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.381577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.381857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.382129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.382870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.384796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.408573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1248/2503] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:32.412793 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.423245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b71e15-a91c-42cd-9fd8-a2a665f7e3c4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.428758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.429410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.429686 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.429961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.430738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.432389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.443642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1256/2504] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:32.448031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.460197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326a3-db7c-4b41-9f1e-4ed51c9ff98b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.465160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b90b-9237-43b5-ae77-27b3ec64b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.465831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b90b-9237-43b5-ae77-27b3ec64b7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.466107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b90b-9237-43b5-ae77-27b3ec64b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.466405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b90b-9237-43b5-ae77-27b3ec64b7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.467148 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b90b-9237-43b5-ae77-27b3ec64b7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.468756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b90b-9237-43b5-ae77-27b3ec64b7a7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.482085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1249/2505] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:32.483412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.494976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd0f1-b798-4a4f-9d1a-c3a132afd9f3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.500587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.501649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.502007 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.502387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] PATH_INFO: `/v3/projects/93ccf5446fda438a956b7841ba330a87/users/a5bb2262c5ec4a238e2be444232927c0/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.520822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ccf5446fda438a956b7841ba330a87, user_id=a5bb2262c5ec4a238e2be444232927c0, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.524290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.540187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1257/2506] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:32 2021] PUT /identity/v3/projects/93ccf5446fda438a956b7841ba330a87/users/a5bb2262c5ec4a238e2be444232927c0/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:32.550391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.550748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.551098 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.579367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] MFA Rules not processed for user `a5bb2262c5ec4a238e2be444232927c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:32.580583 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:32.646298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1250/2507] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:32.650873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.724397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b2166-c7d2-46b5-bee0-fb9a9b4f3f6b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.732137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.732798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.733079 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.733347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.734043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.736037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.766870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1258/2508] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:28:32.771081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.782022 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eeaa0-8e88-4cd3-acc7-129391526235 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.842708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.843370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.843649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.843926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.844642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.846601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.866919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1251/2509] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:28:32 2021] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:32.871605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.882785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50192e3-7608-4147-849b-22f00a5ff512 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.888258 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.888927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.889215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.889497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.890280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.891920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.902962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1259/2510] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:32.907704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.923540 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ebbb3-a5d9-42bc-966c-3b97a86ce97d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:32.932320 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:32.933380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:32.933658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:32.933939 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] PATH_INFO: `/v3/projects/aa8b520c7dc443279b221f1d6099e2c8/users/2d70c1714c914d899482433b083894ac/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:32.950989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8b520c7dc443279b221f1d6099e2c8, user_id=2d70c1714c914d899482433b083894ac, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:32.953669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:32.969207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1252/2511] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:32 2021] PUT /identity/v3/projects/aa8b520c7dc443279b221f1d6099e2c8/users/2d70c1714c914d899482433b083894ac/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:32.973537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:32.983943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab0558-d260-40cf-b990-daebc6ec3d08 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:33.049143 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2972fae-df4b-4c79-85fb-d9af0ac143cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:33.049832 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972fae-df4b-4c79-85fb-d9af0ac143cd admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:33.050332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972fae-df4b-4c79-85fb-d9af0ac143cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:33.050443 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2972fae-df4b-4c79-85fb-d9af0ac143cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:33.051184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972fae-df4b-4c79-85fb-d9af0ac143cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:33.052810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2972fae-df4b-4c79-85fb-d9af0ac143cd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:33.066773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1260/2512] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:32 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:33.073183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:33.079664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d706-a2f6-4926-857c-cdb8527f5941 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:33.084443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:33.085400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:33.085682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:33.085955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] PATH_INFO: `/v3/projects/aa8b520c7dc443279b221f1d6099e2c8/users/2d70c1714c914d899482433b083894ac/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:33.088057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8b520c7dc443279b221f1d6099e2c8, user_id=2d70c1714c914d899482433b083894ac, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:33.091106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:33.101674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1253/2513] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:33 2021] PUT /identity/v3/projects/aa8b520c7dc443279b221f1d6099e2c8/users/2d70c1714c914d899482433b083894ac/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:33.112459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:33.112850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:33.113187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:33.141055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] MFA Rules not processed for user `2d70c1714c914d899482433b083894ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:33.142367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:33.230283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1261/2514] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:33 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:33.240957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:33.249261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:33.330702 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8df05-1714-42d5-8a98-5a2252f8e580 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:33.335279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:33.336012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:33.336291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:33.336671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:33.348846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:33.350407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:33.360396 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1254/2515] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:33 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:33.408038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:33.418689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541cf58-469b-4c6b-98a6-eee5c95b17bf None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:33.422531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d05f07-00fd-41c9-a56e-75469d4da26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:33.423203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d05f07-00fd-41c9-a56e-75469d4da26d service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:33.423473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d05f07-00fd-41c9-a56e-75469d4da26d service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:33.423756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d05f07-00fd-41c9-a56e-75469d4da26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:33.484719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d05f07-00fd-41c9-a56e-75469d4da26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:33.486354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d05f07-00fd-41c9-a56e-75469d4da26d service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:33.497049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1262/2516] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:33 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:36.802413 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:36.867374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7f6f-23e1-43c9-b7ad-7f7744b7b385 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:36.873849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:36.874757 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:36.875039 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:36.875361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] PATH_INFO: `/v3/users/a5bb2262c5ec4a238e2be444232927c0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:36.876628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bb2262c5ec4a238e2be444232927c0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:36.878662 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:36.934512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bb2262c5ec4a238e2be444232927c0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:36.935190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bb2262c5ec4a238e2be444232927c0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:36.935813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bb2262c5ec4a238e2be444232927c0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:36.944576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bb2262c5ec4a238e2be444232927c0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:36.956691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bb2262c5ec4a238e2be444232927c0'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:36.971893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1255/2517] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:36 2021] DELETE /identity/v3/users/a5bb2262c5ec4a238e2be444232927c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:36.973089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:36.973537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:36.973646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:36.992000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:36.993220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:37.054359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1263/2518] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:37.064546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:37.066095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:37.125384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1dba5-baf6-4e43-9094-18c70531186a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:37.131919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:37.132691 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:37.133001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:37.133403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:37.148143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:37.150018 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:37.161569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1256/2519] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:37.456738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:37.458449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:37.473055 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce6fc-ca08-43b4-9a50-2ac3b6fff531 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:37.479318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:37.480552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:37.480833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:37.481106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] PATH_INFO: `/v3/projects/93ccf5446fda438a956b7841ba330a87` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:37.482702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ccf5446fda438a956b7841ba330a87)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:37.484748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:37.533941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ccf5446fda438a956b7841ba330a87', 'request_id': 'req-2afd8c36-919a-46e2-bcff-1c1827d9b97a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.543359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ccf5446fda438a956b7841ba330a87', 'request_id': 'req-2afd8c36-919a-46e2-bcff-1c1827d9b97a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.550302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ccf5446fda438a956b7841ba330a87', 'request_id': 'req-2afd8c36-919a-46e2-bcff-1c1827d9b97a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.562755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] The token cache is being invalidate because project 93ccf5446fda438a956b7841ba330a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:37.562986 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.563626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.565212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1264/2520] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:37 2021] DELETE /identity/v3/projects/93ccf5446fda438a956b7841ba330a87 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:37.569410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:37.580429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80416c0-96a2-4bd5-8006-ddf1dbd55149 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:37.655327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:37.656196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:37.656474 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:37.656754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] PATH_INFO: `/v3/users/2d70c1714c914d899482433b083894ac` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:37.657981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d70c1714c914d899482433b083894ac)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:37.659949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:37.717804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d70c1714c914d899482433b083894ac'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.718471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d70c1714c914d899482433b083894ac'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.719090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d70c1714c914d899482433b083894ac'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.727792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d70c1714c914d899482433b083894ac'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.739881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-06b401d9-4b40-4bc1-bd5d-5e229447d3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d70c1714c914d899482433b083894ac'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:37.752567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1257/2521] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:37 2021] DELETE /identity/v3/users/2d70c1714c914d899482433b083894ac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:38.044603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.046187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:38.060297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd8c36-919a-46e2-bcff-1c1827d9b97a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.125694 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.126595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.126897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.127159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] PATH_INFO: `/v3/projects/aa8b520c7dc443279b221f1d6099e2c8` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.128440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8b520c7dc443279b221f1d6099e2c8)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.131051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.182030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8b520c7dc443279b221f1d6099e2c8', 'request_id': 'req-db94e702-6a78-45a5-9fbc-dee40c64bd9d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:38.191023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8b520c7dc443279b221f1d6099e2c8', 'request_id': 'req-db94e702-6a78-45a5-9fbc-dee40c64bd9d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:38.196866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8b520c7dc443279b221f1d6099e2c8', 'request_id': 'req-db94e702-6a78-45a5-9fbc-dee40c64bd9d'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:38.208157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] The token cache is being invalidate because project aa8b520c7dc443279b221f1d6099e2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:38.208446 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:38.209118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-db94e702-6a78-45a5-9fbc-dee40c64bd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:38.210753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1265/2522] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:38 2021] DELETE /identity/v3/projects/aa8b520c7dc443279b221f1d6099e2c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:28:38.217199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.217737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.217868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.236908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:38.238131 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:38.299881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1258/2523] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:38.309199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.309511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.309780 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.329018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:38.330147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:38.341402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1266/2524] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:38.344367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.354982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb08f-9fbc-41e8-931b-1a367ffe1f48 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.360890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.361570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.361855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.362332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.363079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:28:38.363386 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.365004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.378447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1259/2525] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:28:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:28:38.382782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.392764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af1cfb-4b38-4910-b6c2-74169c08e9a9 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.398288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.398971 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.399256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.399534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.400273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.402574 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.432897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1267/2526] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:38.434372 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.444767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a92f-069f-4ffc-8439-85fb3fe0e132 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.502480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.503174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.503464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.503763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.504485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.506463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.529307 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1260/2527] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:38.533337 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.544293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230329df-03e3-40d6-bac1-04e5d0f53cbc admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.549604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.550326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.550585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.550864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.551620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.553256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.564261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1268/2528] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:38.568341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.581047 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843e96-a423-4664-a61c-de0882e71b06 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.589143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18a202-ebbe-4bc2-b745-65147275845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.589971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a202-ebbe-4bc2-b745-65147275845f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.590349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a202-ebbe-4bc2-b745-65147275845f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.590723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a202-ebbe-4bc2-b745-65147275845f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.591699 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18a202-ebbe-4bc2-b745-65147275845f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.594103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18a202-ebbe-4bc2-b745-65147275845f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.610664 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1261/2529] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:38 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:28:38.615025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.626812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673570-ebe8-48bb-b78b-4aad87cef91a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.632579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.633355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.633639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.633902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] PATH_INFO: `/v3/projects/d798f57ddc444bc9b33bed045f2aaf7e/users/2d8aa8c890a24d218957254c9e4aa261/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.652591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d798f57ddc444bc9b33bed045f2aaf7e, user_id=2d8aa8c890a24d218957254c9e4aa261, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.657196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.676267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1269/2530] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:38 2021] PUT /identity/v3/projects/d798f57ddc444bc9b33bed045f2aaf7e/users/2d8aa8c890a24d218957254c9e4aa261/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:38.687184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.687452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.687779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.717367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] MFA Rules not processed for user `2d8aa8c890a24d218957254c9e4aa261`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:38.718647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:38.789836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1262/2531] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:28:38.794888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.864607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33273c-fada-4d17-9030-10f67d424cd4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.870915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.871572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.871871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.872136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.872840 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.874798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:38.903473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1270/2532] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:38.907754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:38.919922 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57cf8e-f80d-4562-a150-fb89e372d5fc None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:38.981363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f9565-02d3-4878-af72-366602050861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:38.982041 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f9565-02d3-4878-af72-366602050861 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:38.982343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f9565-02d3-4878-af72-366602050861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:38.982611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f9565-02d3-4878-af72-366602050861 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:38.983326 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f9565-02d3-4878-af72-366602050861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:38.985269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f9565-02d3-4878-af72-366602050861 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.007574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1263/2533] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:28:38 2021] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:39.011870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.022452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5d648-a92d-4387-a474-c80f775d95e0 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.027509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.028149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.028427 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.028700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.029455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.031104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.041056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1271/2534] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:39.045566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f9565-02d3-4878-af72-366602050861 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.056000 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f9565-02d3-4878-af72-366602050861 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.060978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.061880 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.062203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.062754 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] PATH_INFO: `/v3/projects/e773159805e04494a19990e37368dc5c/users/2b0191c16a49410897452c53b4b9fc2a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.077283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e773159805e04494a19990e37368dc5c, user_id=2b0191c16a49410897452c53b4b9fc2a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.079958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.095937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1264/2535] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:39 2021] PUT /identity/v3/projects/e773159805e04494a19990e37368dc5c/users/2b0191c16a49410897452c53b4b9fc2a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:39.099967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.109947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c7f86-06c2-42cd-ad71-eaad3f179e55 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.166808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f296-e488-4818-8f2b-c43c25e0b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.167684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f296-e488-4818-8f2b-c43c25e0b5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.167684 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f296-e488-4818-8f2b-c43c25e0b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.167947 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f296-e488-4818-8f2b-c43c25e0b5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.168691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f296-e488-4818-8f2b-c43c25e0b5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.170380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f296-e488-4818-8f2b-c43c25e0b5f8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.181010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1272/2536] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:39 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:39.185565 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.196122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca81b-2084-4fb0-9e26-ecaaeadc2d88 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.201077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.201962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.202277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.202554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] PATH_INFO: `/v3/projects/e773159805e04494a19990e37368dc5c/users/2b0191c16a49410897452c53b4b9fc2a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.204817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] RBAC: Authorizing `identity:create_grant(project_id=e773159805e04494a19990e37368dc5c, user_id=2b0191c16a49410897452c53b4b9fc2a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.207695 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.219639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1265/2537] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:39 2021] PUT /identity/v3/projects/e773159805e04494a19990e37368dc5c/users/2b0191c16a49410897452c53b4b9fc2a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:39.230054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.230573 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.230851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.259623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] MFA Rules not processed for user `2b0191c16a49410897452c53b4b9fc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:39.260925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:39.340248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1273/2538] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:39 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:39.352133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.354460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:39.413631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5af39d-c6af-4a1c-843d-db3dc8ffcece admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.418487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01ff41-a725-4991-9bac-ee144179e917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.419088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01ff41-a725-4991-9bac-ee144179e917 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.419370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01ff41-a725-4991-9bac-ee144179e917 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.419622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01ff41-a725-4991-9bac-ee144179e917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.428911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01ff41-a725-4991-9bac-ee144179e917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.430426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01ff41-a725-4991-9bac-ee144179e917 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.440617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1266/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:39 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:39.568144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.631049 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa2db-d2a6-46a7-8cf6-a26cf4e02ad6 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.638704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.640242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.640689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.641147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] PATH_INFO: `/v3/users/2d8aa8c890a24d218957254c9e4aa261` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.643338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8aa8c890a24d218957254c9e4aa261)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.647121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.722895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8aa8c890a24d218957254c9e4aa261'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:39.723641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8aa8c890a24d218957254c9e4aa261'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:39.724350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8aa8c890a24d218957254c9e4aa261'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:39.737484 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8aa8c890a24d218957254c9e4aa261'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:39.750774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8aa8c890a24d218957254c9e4aa261'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:39.764864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1274/2540] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:39 2021] DELETE /identity/v3/users/2d8aa8c890a24d218957254c9e4aa261 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:39.772016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.772454 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.772884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.798951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:39.800791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:39.876955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1267/2541] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:39.888403 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:39.889873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:39.948340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b001493-e7e6-4139-84d9-a46756995c2b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:39.952503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:39.953153 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:39.953434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:39.953708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:39.963649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:39.965401 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:39.975487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1275/2542] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:40.266615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:40.268832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:40.281412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab575d7-93a1-47c1-b7eb-de9270ef8903 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:40.286392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:40.287243 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:40.287519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:40.287798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] PATH_INFO: `/v3/projects/d798f57ddc444bc9b33bed045f2aaf7e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:40.289012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d798f57ddc444bc9b33bed045f2aaf7e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:40.291847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:40.342787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd798f57ddc444bc9b33bed045f2aaf7e', 'request_id': 'req-56fc173c-0886-4cbe-93dc-b3e3774354de'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.352032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd798f57ddc444bc9b33bed045f2aaf7e', 'request_id': 'req-56fc173c-0886-4cbe-93dc-b3e3774354de'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.357817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd798f57ddc444bc9b33bed045f2aaf7e', 'request_id': 'req-56fc173c-0886-4cbe-93dc-b3e3774354de'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.370332 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] The token cache is being invalidate because project d798f57ddc444bc9b33bed045f2aaf7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:40.370619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.371395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.373059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1268/2543] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:40 2021] DELETE /identity/v3/projects/d798f57ddc444bc9b33bed045f2aaf7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:40.377951 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:40.390870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf0c7-eae7-404c-9f06-ee39eb59702d service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:40.450312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:40.451205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:40.451486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:40.451764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] PATH_INFO: `/v3/users/2b0191c16a49410897452c53b4b9fc2a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:40.452999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0191c16a49410897452c53b4b9fc2a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:40.454970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:40.505510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0191c16a49410897452c53b4b9fc2a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.506146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0191c16a49410897452c53b4b9fc2a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.506777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0191c16a49410897452c53b4b9fc2a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.515565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0191c16a49410897452c53b4b9fc2a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.527564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-70b3efdc-7630-4b38-9eb2-c22a24c38905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0191c16a49410897452c53b4b9fc2a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:40.539559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1276/2544] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:40 2021] DELETE /identity/v3/users/2b0191c16a49410897452c53b4b9fc2a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:40.855333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:40.856886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:40.872510 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc173c-0886-4cbe-93dc-b3e3774354de admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:40.937405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:40.938370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:40.938656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:40.938959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] PATH_INFO: `/v3/projects/e773159805e04494a19990e37368dc5c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:40.940193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e773159805e04494a19990e37368dc5c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:40.942202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:40.996593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e773159805e04494a19990e37368dc5c', 'request_id': 'req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:41.005792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e773159805e04494a19990e37368dc5c', 'request_id': 'req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:41.011549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e773159805e04494a19990e37368dc5c', 'request_id': 'req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:41.022259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] The token cache is being invalidate because project e773159805e04494a19990e37368dc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:41.022547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:41.023185 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-9b21a526-cb8f-4ab4-8f25-74f58283ad0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:41.024743 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1269/2545] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:40 2021] DELETE /identity/v3/projects/e773159805e04494a19990e37368dc5c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:41.030718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.031099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.031386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.051880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:41.053123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:41.115718 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1277/2546] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:41.124506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.124804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.125076 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.150142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:41.152019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:41.161116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1270/2547] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:41.165583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.175943 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d50595-45e2-4ab4-92b5-04012923d6d7 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.182213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.182964 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.183248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.183608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.184410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:28:41.184720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.186431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.199224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1278/2548] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:28:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:28:41.203531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.213230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a3e87-42db-4221-8870-f4c46ddc007b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.219062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.219721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.220004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.220277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.220992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.222946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.255459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1271/2549] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:28:41 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:41.256599 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.267683 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c39d7-1b9c-41b9-bd11-003a2dba1b15 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.332311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.333133 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.333420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.333691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.334492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.336432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.363459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1279/2550] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:28:41 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:28:41.364990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.377308 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d056f3-a705-468d-833c-45bac769b592 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.382558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.383231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.383507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.383778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.384514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.386517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.400080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1272/2551] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:28:41.402108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.413118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c75b3d-cc96-48b9-8f5e-b08c0a77faf4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.418498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2498cf-ae3d-48e4-ad5d-05da72cfb7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.419152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2498cf-ae3d-48e4-ad5d-05da72cfb7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.419433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2498cf-ae3d-48e4-ad5d-05da72cfb7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.419705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2498cf-ae3d-48e4-ad5d-05da72cfb7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.420463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2498cf-ae3d-48e4-ad5d-05da72cfb7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.422083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2498cf-ae3d-48e4-ad5d-05da72cfb7ee admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.438047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1280/2552] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:28:41.439417 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.450574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75624937-22f0-4f12-aeb2-f2a4ac14b51c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.458708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.459901 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.460327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.460714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] PATH_INFO: `/v3/projects/310e6d6cd0c541d08ba0446ec1f0c4d7/users/946288eee3d74de490340ed1db8165c5/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.479685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e6d6cd0c541d08ba0446ec1f0c4d7, user_id=946288eee3d74de490340ed1db8165c5, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.483546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.501141 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1273/2553] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:28:41 2021] PUT /identity/v3/projects/310e6d6cd0c541d08ba0446ec1f0c4d7/users/946288eee3d74de490340ed1db8165c5/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:41.511855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.512281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.512568 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.548654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] MFA Rules not processed for user `946288eee3d74de490340ed1db8165c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:28:41.548654 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:41.610823 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1281/2554] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:28:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:28:41.624447 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:41.626208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:41.687544 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75459711-110f-4c58-ba13-99932c629505 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:41.691259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:41.691932 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:41.692207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:41.692481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:41.701109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:41.702573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:41.711218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1274/2555] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:41 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:28:53.945111 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:53.947130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:54.008664 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac60e1-aeda-48bc-8258-5875627bdc84 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:54.013561 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:54.014369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:54.014680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:54.014954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:54.016787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:54.095785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:54.097268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:54.107959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1282/2556] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:28:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:28:54.624315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:54.625950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:28:54.642191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80dca2-28b9-4028-9216-c04217050afd service glance] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:54.647708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:54.648703 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:54.648904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:54.649172 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] PATH_INFO: `/v3/users/2c17a5a54a8b40f9901f9b86b4353955` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:54.650506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c17a5a54a8b40f9901f9b86b4353955)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:54.652460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:54.706145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c17a5a54a8b40f9901f9b86b4353955'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:54.706926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c17a5a54a8b40f9901f9b86b4353955'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:54.707577 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c17a5a54a8b40f9901f9b86b4353955'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:54.715603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c17a5a54a8b40f9901f9b86b4353955'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:54.727525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c17a5a54a8b40f9901f9b86b4353955'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:54.743806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1275/2557] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:28:54 2021] DELETE /identity/v3/users/2c17a5a54a8b40f9901f9b86b4353955 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:28:54.924425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:28:54.939330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c87f-1e0d-4655-8936-02bce2e427c8 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:28:55.006819 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:28:55.007705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:28:55.007989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:28:55.008268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] PATH_INFO: `/v3/projects/dd267c8ea8e646dbbb902d8b5f8c31a0` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:28:55.009566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd267c8ea8e646dbbb902d8b5f8c31a0)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:28:55.011542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:28:55.059802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'request_id': 'req-160f3c4b-89c2-47a6-8bab-e627b2dda58f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:55.069099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'request_id': 'req-160f3c4b-89c2-47a6-8bab-e627b2dda58f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:55.074616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd267c8ea8e646dbbb902d8b5f8c31a0', 'request_id': 'req-160f3c4b-89c2-47a6-8bab-e627b2dda58f'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:55.085980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] The token cache is being invalidate because project dd267c8ea8e646dbbb902d8b5f8c31a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:28:55.086324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:55.087004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-160f3c4b-89c2-47a6-8bab-e627b2dda58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:28:55.088637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1283/2558] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:28:54 2021] DELETE /identity/v3/projects/dd267c8ea8e646dbbb902d8b5f8c31a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:00.381324 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:00.383071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:00.397196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669213b-2cc1-442c-a556-98047f5f2c05 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:00.457884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:00.458801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:00.459083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:00.459354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] PATH_INFO: `/v3/users/946288eee3d74de490340ed1db8165c5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:00.460728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946288eee3d74de490340ed1db8165c5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:00.462963 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:00.513811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946288eee3d74de490340ed1db8165c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:00.514400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946288eee3d74de490340ed1db8165c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:00.515028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946288eee3d74de490340ed1db8165c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:00.524236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946288eee3d74de490340ed1db8165c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:00.542981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946288eee3d74de490340ed1db8165c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:00.558259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1276/2559] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:29:00 2021] DELETE /identity/v3/users/946288eee3d74de490340ed1db8165c5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:00.564099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:00.564611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:00.564729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:00.589898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:00.591166 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:00.658420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1284/2560] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:00.668437 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:00.669992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:00.736671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812d9c-60d3-4d87-9172-a547912529b7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:00.740795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396aca1-548b-48e7-9955-9b7004970f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:00.741439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396aca1-548b-48e7-9955-9b7004970f8d service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:00.741722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396aca1-548b-48e7-9955-9b7004970f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:00.741997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396aca1-548b-48e7-9955-9b7004970f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:00.752828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396aca1-548b-48e7-9955-9b7004970f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:00.754259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396aca1-548b-48e7-9955-9b7004970f8d service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:00.765028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1277/2561] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:01.047917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.049482 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:01.063329 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5ac61-e709-4232-8a3b-f04d4f089f78 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.068381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.069273 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.069557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.069833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] PATH_INFO: `/v3/projects/310e6d6cd0c541d08ba0446ec1f0c4d7` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.071164 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310e6d6cd0c541d08ba0446ec1f0c4d7)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.073208 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.120222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310e6d6cd0c541d08ba0446ec1f0c4d7', 'request_id': 'req-d1d3837c-d56e-4485-9329-0cec2c103841'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:01.129059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310e6d6cd0c541d08ba0446ec1f0c4d7', 'request_id': 'req-d1d3837c-d56e-4485-9329-0cec2c103841'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:01.134863 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310e6d6cd0c541d08ba0446ec1f0c4d7', 'request_id': 'req-d1d3837c-d56e-4485-9329-0cec2c103841'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:01.146033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] The token cache is being invalidate because project 310e6d6cd0c541d08ba0446ec1f0c4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:29:01.146350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:01.146975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d1d3837c-d56e-4485-9329-0cec2c103841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:01.148517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1285/2562] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:29:01 2021] DELETE /identity/v3/projects/310e6d6cd0c541d08ba0446ec1f0c4d7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:01.155210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.155487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.155762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.174139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:01.175444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:01.242757 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1278/2563] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:01.294440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.294796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.294909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.318486 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:01.320348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:01.331138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1286/2564] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:01.337648 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.348299 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305737-88ca-4b88-866e-29bc6120205a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.354514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.355188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.355442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.355744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.356492 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:29:01.356797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.358455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.371072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1279/2565] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:29:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:29:01.377282 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.390701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2b7cf-51a2-4f04-bfe7-4c29524c3304 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.399588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.400795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.401084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.401373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.402089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.404066 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.438499 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1287/2566] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:29:01 2021] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:29:01.446217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.458055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbbbd-92f7-49ab-8aa7-dbf3117ea69e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.522748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.523502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.523787 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.524063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.524769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.526881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.549701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1280/2567] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:29:01 2021] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:01.553858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.568509 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660307f-e123-43af-bcb8-7c062306b332 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.577005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.577729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.578009 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.578314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.579089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.580722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.592327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1288/2568] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:01.597054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.608868 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591f7ea-2127-40bd-bc94-5f661d7df61e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.614516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6b0c7-0ef6-4ca6-b8d8-60b151a989a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.615340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6b0c7-0ef6-4ca6-b8d8-60b151a989a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.615631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6b0c7-0ef6-4ca6-b8d8-60b151a989a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.615912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6b0c7-0ef6-4ca6-b8d8-60b151a989a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.616761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6b0c7-0ef6-4ca6-b8d8-60b151a989a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.618727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6b0c7-0ef6-4ca6-b8d8-60b151a989a8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.630487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1281/2569] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:01.635531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.652194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b2108-bf42-4f9f-bedf-0023d43bbe9a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.658152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.659100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.659376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.659650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] PATH_INFO: `/v3/projects/d58cab772258420585bc1fbc4fb32268/users/cedc6fbeb7d444c88f12469ddd051323/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.677174 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58cab772258420585bc1fbc4fb32268, user_id=cedc6fbeb7d444c88f12469ddd051323, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.679876 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.696014 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1289/2570] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:29:01 2021] PUT /identity/v3/projects/d58cab772258420585bc1fbc4fb32268/users/cedc6fbeb7d444c88f12469ddd051323/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:01.706833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.707121 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.707439 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.736111 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] MFA Rules not processed for user `cedc6fbeb7d444c88f12469ddd051323`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:01.737336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:01.805257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1282/2571] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:01 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:29:01.833125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:01.835151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:01.896723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bffca-5004-4d46-a1a6-6d796040d57b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:01.901952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe117665-0d62-47e9-8911-dd578cf0ca1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:01.902979 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117665-0d62-47e9-8911-dd578cf0ca1f service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:01.903360 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117665-0d62-47e9-8911-dd578cf0ca1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:01.903749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117665-0d62-47e9-8911-dd578cf0ca1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:01.919098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe117665-0d62-47e9-8911-dd578cf0ca1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:01.921338 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe117665-0d62-47e9-8911-dd578cf0ca1f service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:01.934407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1290/2572] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:01 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:01.949233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:02.019792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827bae8-14ff-4019-ae11-4f42f615e63b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:02.027790 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:02.028684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.028968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.029248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] PATH_INFO: `/v3/users/cedc6fbeb7d444c88f12469ddd051323` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.030683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedc6fbeb7d444c88f12469ddd051323)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:02.032656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:02.095027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedc6fbeb7d444c88f12469ddd051323'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.095697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedc6fbeb7d444c88f12469ddd051323'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.096368 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedc6fbeb7d444c88f12469ddd051323'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.105520 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedc6fbeb7d444c88f12469ddd051323'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.122373 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedc6fbeb7d444c88f12469ddd051323'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.135160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1283/2573] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:29:01 2021] DELETE /identity/v3/users/cedc6fbeb7d444c88f12469ddd051323 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:02.140322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.140614 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.140896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.158373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:02.159570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:02.220700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1291/2574] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:02.231029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:02.232536 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:02.290719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eeeb5-0b6f-4706-a6b4-e74639a7a9ea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:02.295392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8f99d-bf65-4e86-903e-b7a884116a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:02.296043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f99d-bf65-4e86-903e-b7a884116a6b service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.296325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f99d-bf65-4e86-903e-b7a884116a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.296597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8f99d-bf65-4e86-903e-b7a884116a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.305848 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f99d-bf65-4e86-903e-b7a884116a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:02.307329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8f99d-bf65-4e86-903e-b7a884116a6b service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:02.316786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1284/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:02.582930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:02.584518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:02.599288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49751cfc-5c59-4c55-8f5c-8be8d8d32bdf None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:02.606107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:02.607037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.607322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.607624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] PATH_INFO: `/v3/projects/d58cab772258420585bc1fbc4fb32268` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.609021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58cab772258420585bc1fbc4fb32268)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:02.611048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:02.666808 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58cab772258420585bc1fbc4fb32268', 'request_id': 'req-f8237a9d-9b4c-41f2-8c44-720fd64720a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.676151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58cab772258420585bc1fbc4fb32268', 'request_id': 'req-f8237a9d-9b4c-41f2-8c44-720fd64720a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.682183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58cab772258420585bc1fbc4fb32268', 'request_id': 'req-f8237a9d-9b4c-41f2-8c44-720fd64720a6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.693431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] The token cache is being invalidate because project d58cab772258420585bc1fbc4fb32268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:29:02.693717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.694421 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-f8237a9d-9b4c-41f2-8c44-720fd64720a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:02.695996 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1292/2576] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:29:02 2021] DELETE /identity/v3/projects/d58cab772258420585bc1fbc4fb32268 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:02.702234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.702733 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.702849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.721313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:02.722616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:02.785338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1285/2577] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:02.793858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.794140 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.794458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.815611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:02.816865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:02.826488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1293/2578] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:02.830961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:02.840919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba26c-9612-4659-a170-f0bcc2913337 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:02.845815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:02.846497 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.846781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.847054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.847797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:29:02.848097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:02.849697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:02.861334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1286/2579] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:29:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:29:02.865806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:02.876200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9158d-2a76-4ffa-a8fb-cc28e955bd24 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:02.881733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:02.882436 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:02.882728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:02.883004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:02.883729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:02.885703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:02.919580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1294/2580] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:29:02 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:02.923857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:02.936387 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de05605-99e1-4bfc-a0a6-f7176d97cadf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.016174 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.016854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.017142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.017403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.018107 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.020164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.043273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1287/2581] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:29:02 2021] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:03.047746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.058423 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d91a1-fb29-47d5-a7f0-321bfbf5d97f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.063459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.064131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.064409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.064692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.065437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.067090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.080400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1295/2582] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:03.085162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.101152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2402-dfb4-4d8d-bc57-50f07bf110f4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.107744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017a62d-cb47-4363-9952-4a41730990f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.108636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a62d-cb47-4363-9952-4a41730990f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.108937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a62d-cb47-4363-9952-4a41730990f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.109306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017a62d-cb47-4363-9952-4a41730990f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.110509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017a62d-cb47-4363-9952-4a41730990f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.112982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017a62d-cb47-4363-9952-4a41730990f6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.127763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1288/2583] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:03.134396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.146151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4ef4-1711-457e-a462-b726f5e7f37c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.151665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.152619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.152899 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.153175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] PATH_INFO: `/v3/projects/0c4e72fe67864800ac36169a626b3d67/users/710819220ea14b189d3fca10a4bc5563/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.168891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4e72fe67864800ac36169a626b3d67, user_id=710819220ea14b189d3fca10a4bc5563, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.171661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.188278 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1296/2584] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:29:03 2021] PUT /identity/v3/projects/0c4e72fe67864800ac36169a626b3d67/users/710819220ea14b189d3fca10a4bc5563/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:03.203808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.204097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.204381 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.232949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] MFA Rules not processed for user `710819220ea14b189d3fca10a4bc5563`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:03.234153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:03.312464 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1289/2585] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:03 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:03.315290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.380230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32df63-b94a-4092-bff2-481a459e5b1f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.385126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.385816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.386085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.386796 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.387430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.389362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.415960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1297/2586] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:29:03 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:29:03.422094 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.434559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54afa1-bae5-4c78-b75b-06161705ab6e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.503048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.503769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.504057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.504340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.505064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.507052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.531495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1290/2587] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:29:03 2021] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:03.535763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.547354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4217d-ee08-46b4-8c06-64cd666edbf5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.553023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.553751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.554056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.554412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.555172 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.556782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.568384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1298/2588] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:03.572627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.582642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d5fc6-eb56-48b3-a6e8-b5acbde7224a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.587557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de96c-b64c-4dce-813e-4822fb0ba3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.588218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de96c-b64c-4dce-813e-4822fb0ba3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.588501 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de96c-b64c-4dce-813e-4822fb0ba3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.588781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de96c-b64c-4dce-813e-4822fb0ba3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.589623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de96c-b64c-4dce-813e-4822fb0ba3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.591366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de96c-b64c-4dce-813e-4822fb0ba3a4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.601371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1291/2589] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:03.605750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.615782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890397cd-9b1e-459c-9815-ea371630e62b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.621544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.622547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.622804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.623085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] PATH_INFO: `/v3/projects/de65b717195c4bb69693492d818bb77f/users/be23552e92cc443c8725378641b311a1/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.639137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de65b717195c4bb69693492d818bb77f, user_id=be23552e92cc443c8725378641b311a1, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.641833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.658391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1299/2590] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:29:03 2021] PUT /identity/v3/projects/de65b717195c4bb69693492d818bb77f/users/be23552e92cc443c8725378641b311a1/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:29:03.671930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.672272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.672490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.705322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] MFA Rules not processed for user `be23552e92cc443c8725378641b311a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:03.706614 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:03.782799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1292/2591] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:03 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:03.787948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.862290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198f944-e3fb-4dd6-b231-da4a3552cec4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.868473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.869611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.869933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.870315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.871180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.873768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:03.903450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1300/2592] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:29:03 2021] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:03.908286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:03.922708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd16fc1-637a-40e5-8264-2ee1bcbbbe44 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:03.980353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:03.981056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:03.981336 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:03.981638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:03.982363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:03.984337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:04.007160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1293/2593] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:29:03 2021] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:04.013062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:04.028735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6d91-28b7-4ee7-9a70-bbeeaf85dfbd admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:04.034376 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:04.035069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:04.035350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:04.035625 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:04.036380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:04.038041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:04.048768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1301/2594] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:04.053133 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:04.063405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22325-4b85-4adc-891b-132e9e014d94 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:04.068521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:04.069400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:04.069674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:04.069947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] PATH_INFO: `/v3/projects/24d1ef3ed88f421389aee246c6523cac/users/d32a1ce5694444738516835d0387919a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:04.084870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d1ef3ed88f421389aee246c6523cac, user_id=d32a1ce5694444738516835d0387919a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:04.087581 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:04.109132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1294/2595] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:29:04 2021] PUT /identity/v3/projects/24d1ef3ed88f421389aee246c6523cac/users/d32a1ce5694444738516835d0387919a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:29:04.114652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:04.125516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ea8a7-5da2-43e0-b920-18acc9e184b3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:04.192855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345f943-8615-4e73-9a59-817caf5077f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:04.193438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345f943-8615-4e73-9a59-817caf5077f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:04.193723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345f943-8615-4e73-9a59-817caf5077f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:04.194001 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345f943-8615-4e73-9a59-817caf5077f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:04.194789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345f943-8615-4e73-9a59-817caf5077f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:04.196416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345f943-8615-4e73-9a59-817caf5077f8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:04.206888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1302/2596] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:04 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:04.211268 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:04.222188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126f1a-7b88-4221-a187-acd6f211ad0e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:04.227428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:04.228338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:04.228627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:04.228903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] PATH_INFO: `/v3/projects/24d1ef3ed88f421389aee246c6523cac/users/d32a1ce5694444738516835d0387919a/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:04.231615 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d1ef3ed88f421389aee246c6523cac, user_id=d32a1ce5694444738516835d0387919a, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:04.234350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:04.246222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1295/2597] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:29:04 2021] PUT /identity/v3/projects/24d1ef3ed88f421389aee246c6523cac/users/d32a1ce5694444738516835d0387919a/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:04.256763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:04.257081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:04.257384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:04.284936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] MFA Rules not processed for user `d32a1ce5694444738516835d0387919a`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:04.286136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:04.359125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1303/2598] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:04 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:04.374111 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:04.376122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:04.448008 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36cfa-8909-45f7-abc1-900a87ef8290 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:04.453026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:04.453674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:04.453957 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:04.454230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:04.521752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:04.523244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:04.533007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1296/2599] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:04 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:06.041472 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:06.051825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccbbe5-d06a-492f-a2df-ac0b1d6adbee None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:06.055634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:06.056315 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:06.056595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:06.056862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:06.138649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:06.140130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:06.149750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1304/2600] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:06 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:06.699303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:06.701418 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:06.733924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586eb9e-fc64-4cc2-82ee-3a70e9ba8f13 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:06.738106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7c01b-6e80-4946-989d-8e37014fa3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:06.738805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7c01b-6e80-4946-989d-8e37014fa3eb service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:06.739083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7c01b-6e80-4946-989d-8e37014fa3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:06.739351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7c01b-6e80-4946-989d-8e37014fa3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:06.756412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7c01b-6e80-4946-989d-8e37014fa3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:06.757837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7c01b-6e80-4946-989d-8e37014fa3eb service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:06.768768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1297/2601] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:06 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:10.691449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:10.766704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692cb83-8d8f-4e28-b305-fda3b85bfbd1 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:10.771705 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:10.772570 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:10.772849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:10.773120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] PATH_INFO: `/v3/users/710819220ea14b189d3fca10a4bc5563` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:10.774391 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=710819220ea14b189d3fca10a4bc5563)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:10.776339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:10.826450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710819220ea14b189d3fca10a4bc5563'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:10.827099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710819220ea14b189d3fca10a4bc5563'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:10.827873 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710819220ea14b189d3fca10a4bc5563'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:10.837157 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710819220ea14b189d3fca10a4bc5563'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:10.849159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710819220ea14b189d3fca10a4bc5563'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:10.863646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1305/2602] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:29:10 2021] DELETE /identity/v3/users/710819220ea14b189d3fca10a4bc5563 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:10.869525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:10.870096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:10.870096 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:10.890201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:10.891325 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:10.954092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1298/2603] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:10.964345 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:10.965804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:11.029579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a797b5f-bbd2-44c9-8d62-c597a14e9fed admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:11.033913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:11.034603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:11.034888 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:11.035165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:11.054792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:11.056956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:11.073123 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1306/2604] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:11.344668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:11.346292 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:11.358835 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047a4f-4c8b-4411-9a56-91290fbecaec None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:11.364477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:11.365371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:11.365659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:11.366026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] PATH_INFO: `/v3/projects/0c4e72fe67864800ac36169a626b3d67` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:11.367491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4e72fe67864800ac36169a626b3d67)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:11.369813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:11.420650 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4e72fe67864800ac36169a626b3d67', 'request_id': 'req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.430732 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4e72fe67864800ac36169a626b3d67', 'request_id': 'req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.437036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4e72fe67864800ac36169a626b3d67', 'request_id': 'req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.448980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] The token cache is being invalidate because project 0c4e72fe67864800ac36169a626b3d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:29:11.449269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.449982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.451672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1299/2605] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:29:11 2021] DELETE /identity/v3/projects/0c4e72fe67864800ac36169a626b3d67 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:11.457518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:11.470981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db8931-9b0a-4d28-a299-447a4bf63545 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:11.535859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:11.536764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:11.537043 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:11.537293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] PATH_INFO: `/v3/users/be23552e92cc443c8725378641b311a1` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:11.538689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be23552e92cc443c8725378641b311a1)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:11.540665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:11.590782 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be23552e92cc443c8725378641b311a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.591541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be23552e92cc443c8725378641b311a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.592210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be23552e92cc443c8725378641b311a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.601402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be23552e92cc443c8725378641b311a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.613065 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be23552e92cc443c8725378641b311a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:11.626296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1307/2606] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:29:11 2021] DELETE /identity/v3/users/be23552e92cc443c8725378641b311a1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:11.908950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:11.910516 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:11.925553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3c6c-b720-48c8-99e1-d347bd0b43c9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:11.983930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:11.984930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:11.985248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:11.985527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] PATH_INFO: `/v3/projects/de65b717195c4bb69693492d818bb77f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:11.986809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de65b717195c4bb69693492d818bb77f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:11.988751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:12.046083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de65b717195c4bb69693492d818bb77f', 'request_id': 'req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.056284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de65b717195c4bb69693492d818bb77f', 'request_id': 'req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.062187 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de65b717195c4bb69693492d818bb77f', 'request_id': 'req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.073262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] The token cache is being invalidate because project de65b717195c4bb69693492d818bb77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:29:12.073553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.074392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.076138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1300/2607] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:29:11 2021] DELETE /identity/v3/projects/de65b717195c4bb69693492d818bb77f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:12.080878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:12.086624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:12.100018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbfab6-422b-47ec-9b5b-f1930fc53058 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:12.167047 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:12.167941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:12.168221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:12.168492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] PATH_INFO: `/v3/users/d32a1ce5694444738516835d0387919a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:12.169749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32a1ce5694444738516835d0387919a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:12.171717 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:12.231521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32a1ce5694444738516835d0387919a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.232226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32a1ce5694444738516835d0387919a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.232897 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32a1ce5694444738516835d0387919a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.241926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32a1ce5694444738516835d0387919a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.255188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1019e904-34d6-41da-a854-6c794308f14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32a1ce5694444738516835d0387919a'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.267770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1308/2608] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:29:12 2021] DELETE /identity/v3/users/d32a1ce5694444738516835d0387919a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:12.557318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:12.558889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:12.571950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf960a8-e5bb-4390-aa7a-c3230c6a50e4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:12.635228 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:12.636159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:12.636435 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:12.636708 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] PATH_INFO: `/v3/projects/24d1ef3ed88f421389aee246c6523cac` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:12.638059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d1ef3ed88f421389aee246c6523cac)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:12.640099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:12.690628 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d1ef3ed88f421389aee246c6523cac', 'request_id': 'req-3196c019-66f6-448b-be71-69867ac4a18a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.700091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d1ef3ed88f421389aee246c6523cac', 'request_id': 'req-3196c019-66f6-448b-be71-69867ac4a18a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.706333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d1ef3ed88f421389aee246c6523cac', 'request_id': 'req-3196c019-66f6-448b-be71-69867ac4a18a'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.717517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] The token cache is being invalidate because project 24d1ef3ed88f421389aee246c6523cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:29:12.717805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.718558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3196c019-66f6-448b-be71-69867ac4a18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:12.720253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1301/2609] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:29:12 2021] DELETE /identity/v3/projects/24d1ef3ed88f421389aee246c6523cac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:12.726152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:12.726471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:12.726748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:12.746528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:12.747665 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:12.813729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1309/2610] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:12.822416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:12.822734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:12.823019 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:12.842987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:12.844236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:12.852536 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1302/2611] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:12.857117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:12.867297 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98455a4-72b8-423f-b292-fd3c557ae9fb None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:12.872875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:12.873529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:12.873813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:12.874083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:12.874925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:29:12.875230 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:12.877048 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:12.888998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1310/2612] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:29:12.893828 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:12.903450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53c457-6b80-49e8-94a1-8ea5e87dadd0 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:12.909816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:12.910483 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:12.910767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:12.911042 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:12.911757 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:12.913778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:12.945129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1303/2613] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:29:12 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:12.949481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:12.960566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dfc0e-e53d-462a-9001-4d0a21298db1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:13.020272 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:13.020966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:13.021239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:13.021519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:13.022373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:13.024148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:13.046194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1311/2614] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:29:12 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:29:13.050638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:13.061400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d177ab-3a17-48b8-8da0-b725cd75b7b5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:13.067405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:13.068068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:13.068347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:13.068657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:13.069395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:13.071031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:13.082896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1304/2615] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:13.088887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:13.099719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251776c-9a9b-4132-ad8f-3fc5708ce973 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:13.104839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73cd6-ca91-4be4-ae08-81360d9c11f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:13.105502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73cd6-ca91-4be4-ae08-81360d9c11f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:13.105784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73cd6-ca91-4be4-ae08-81360d9c11f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:13.106062 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73cd6-ca91-4be4-ae08-81360d9c11f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:13.106844 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73cd6-ca91-4be4-ae08-81360d9c11f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:13.108497 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73cd6-ca91-4be4-ae08-81360d9c11f5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:13.119169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1312/2616] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:29:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:29:13.123409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:13.138711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae0e99-28d5-4c04-bb14-fdf9862ae46e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:13.144104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:13.144980 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:13.145255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:13.145531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] PATH_INFO: `/v3/projects/d7f072d495064cb5a8531edad94a28cd/users/a6c9043b9afe44cdbee339eab9351663/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:13.160969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f072d495064cb5a8531edad94a28cd, user_id=a6c9043b9afe44cdbee339eab9351663, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:13.163700 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:13.179259 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1305/2617] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:29:13 2021] PUT /identity/v3/projects/d7f072d495064cb5a8531edad94a28cd/users/a6c9043b9afe44cdbee339eab9351663/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:13.189927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:13.190257 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:13.190532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:13.220156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] MFA Rules not processed for user `a6c9043b9afe44cdbee339eab9351663`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:13.221371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:13.294147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1313/2618] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:13 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:13.305001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:13.307137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:13.375495 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff75c40-bd59-4ffb-a87d-074dab7b13b3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:13.380346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:13.381005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:13.381288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:13.381566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:13.390926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:13.392379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:13.401911 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1306/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:13 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:16.380685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:16.382286 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:16.485132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb472-0241-4643-8350-dbba1571cb9a None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:16.491113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:16.491759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:16.492036 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:16.492317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:16.494578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:16.507086 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:16.508729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313b8d5-7400-40f4-8b42-7a1f8313307d service placement] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:16.519179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1314/2620] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:23.332987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:23.407006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87603ce8-ea8a-43b6-9e11-125ab71b9065 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:23.412499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:23.413498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:23.413775 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:23.414053 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] PATH_INFO: `/v3/users/a6c9043b9afe44cdbee339eab9351663` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:23.415491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c9043b9afe44cdbee339eab9351663)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:23.417457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:23.466021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c9043b9afe44cdbee339eab9351663'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:23.466760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c9043b9afe44cdbee339eab9351663'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:23.467323 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c9043b9afe44cdbee339eab9351663'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:23.475977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c9043b9afe44cdbee339eab9351663'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:23.488226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c9043b9afe44cdbee339eab9351663'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:23.501426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1307/2621] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:29:23 2021] DELETE /identity/v3/users/a6c9043b9afe44cdbee339eab9351663 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:29:23.506585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:23.507098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:23.507235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:23.525877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:29:23.527125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:23.593923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1315/2622] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:29:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:29:23.605286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:23.607564 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:23.678566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b20a4-99a1-400e-adfb-7a456a709792 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:23.683142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d65320-bfc6-44d3-9417-96b9215f0a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:23.683813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d65320-bfc6-44d3-9417-96b9215f0a54 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:23.684093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d65320-bfc6-44d3-9417-96b9215f0a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:23.684363 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d65320-bfc6-44d3-9417-96b9215f0a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:23.695037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d65320-bfc6-44d3-9417-96b9215f0a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:23.696509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d65320-bfc6-44d3-9417-96b9215f0a54 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:23.706191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1308/2623] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:29:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:29:24.017240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:29:24.019560 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:29:24.032199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd18a4d-e1e7-49a8-a974-4cdf07660eb4 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:29:24.037998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:29:24.038931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:29:24.039217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:29:24.039487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] PATH_INFO: `/v3/projects/d7f072d495064cb5a8531edad94a28cd` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:29:24.041012 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f072d495064cb5a8531edad94a28cd)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:29:24.043254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:29:24.093685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f072d495064cb5a8531edad94a28cd', 'request_id': 'req-42798816-729d-4be4-be42-48b837ab31a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:24.102450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f072d495064cb5a8531edad94a28cd', 'request_id': 'req-42798816-729d-4be4-be42-48b837ab31a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:24.108010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f072d495064cb5a8531edad94a28cd', 'request_id': 'req-42798816-729d-4be4-be42-48b837ab31a5'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:24.119530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] The token cache is being invalidate because project d7f072d495064cb5a8531edad94a28cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:29:24.119813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:24.120452 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:29:24.122084 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1316/2624] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:29:24 2021] DELETE /identity/v3/projects/d7f072d495064cb5a8531edad94a28cd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:30:13.306762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:13.307288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:13.307288 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:13.324677 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] MFA Rules not processed for user `b865802b111a42118b385d68fb89f352`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:30:13.325916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:13.392157 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1309/2625] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:30:13 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:30:13.731371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:13.732866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:13.807763 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798816-729d-4be4-be42-48b837ab31a5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:13.811963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:13.812612 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:13.812894 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:13.813168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:13.815109 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:13.826057 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:13.827546 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:13.836679 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1317/2626] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:30:14.198722 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:14.200284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:14.273762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf842b9-97d1-4260-a9ca-d40e1d4eb45e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:14.278637 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:14.279289 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:14.279566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:14.279875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:14.281735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:14.293654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:14.295201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:14.305917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1310/2627] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:30:22.761655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:22.763352 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:22.850833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f5c8-4895-4675-89ab-244d9ed27572 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:22.856309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:22.856961 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:22.857253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:22.857526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:22.859326 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:22.871541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:22.873147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:22.883866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1318/2628] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:30:30.261455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:30.277924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8b2c-a27e-4751-a75c-6998cde44290 service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:30.284367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:30.285176 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:30.285462 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:30.285738 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:30.287928 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:30.301306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:30.302973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:30.314400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1311/2629] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:30:31.485194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:31.486949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:31.499636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4760-e507-4e18-8b20-5e51d158c748 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:31.503194 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:31.503838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:31.504118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:31.504392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:31.506210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:31.574884 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:31.576354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:31.586510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1319/2630] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:30:32.124620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.126361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:32.140988 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5faffc-1dfe-4b96-881f-d47b65591c54 service nova] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.145616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.146524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.146801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.147081 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] PATH_INFO: `/v3/users/d50d9103fa7d4f74bd77defac782f225` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.148297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50d9103fa7d4f74bd77defac782f225)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:32.150274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:32.206941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50d9103fa7d4f74bd77defac782f225'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.207590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50d9103fa7d4f74bd77defac782f225'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.208186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50d9103fa7d4f74bd77defac782f225'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.217246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50d9103fa7d4f74bd77defac782f225'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.231406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c674f35b-f309-4e78-aeae-59edf54bda85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50d9103fa7d4f74bd77defac782f225'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.246956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1312/2631] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:30:32 2021] DELETE /identity/v3/users/d50d9103fa7d4f74bd77defac782f225 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:30:32.437597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.448359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd3601-1ac9-4600-8fec-7de4f6d27107 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.510993 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.511874 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.512162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.512440 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] PATH_INFO: `/v3/projects/e776c427146842c1ba9637dc29f7281e` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.513768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e776c427146842c1ba9637dc29f7281e)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:32.515811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:32.565923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e776c427146842c1ba9637dc29f7281e', 'request_id': 'req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.574281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e776c427146842c1ba9637dc29f7281e', 'request_id': 'req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.582310 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e776c427146842c1ba9637dc29f7281e', 'request_id': 'req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.596319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] The token cache is being invalidate because project e776c427146842c1ba9637dc29f7281e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:30:32.596610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.597309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1e8e91b6-4727-4736-acba-8b8b79ebdcb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:30:32.599197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1320/2632] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:30:32 2021] DELETE /identity/v3/projects/e776c427146842c1ba9637dc29f7281e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:30:32.607366 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.607667 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.607918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.627624 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:30:32.628885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:32.693812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1313/2633] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:30:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:30:32.702438 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.702728 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.703004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.724317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:30:32.725532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:32.735583 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1321/2634] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:30:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:30:32.739951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.750404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a9974-a340-4f81-8c91-2a9b5907916d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.756488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.757142 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.757422 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.757698 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.758523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:30:32.758837 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:32.760823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:32.772756 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1314/2635] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:30:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:30:32.777301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.787006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929b623-7e09-44fe-af42-49a7d7940713 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.793052 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.793706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.793989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.794295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.795016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:32.796913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:32.827652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1322/2636] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:30:32 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:30:32.831659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.842066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056fc63-1030-4405-bf4a-434e6f378a67 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.906426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.907109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.907394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.907657 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.908400 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:32.910596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:32.936971 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1315/2637] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:30:32 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:30:32.938237 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.950360 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4e6fd-324a-481f-ae06-62b5d12187f1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.956279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.956953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.957232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.957500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.958294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:32.959937 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:32.971652 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1323/2638] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:30:32 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:30:32.976222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:32.989352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15438ee-f46a-418d-8e00-113516b990db admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:32.996675 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168a56-934b-4aeb-8c58-285b046fbee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:32.997331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168a56-934b-4aeb-8c58-285b046fbee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:32.997606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168a56-934b-4aeb-8c58-285b046fbee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:32.997877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168a56-934b-4aeb-8c58-285b046fbee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:32.998666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168a56-934b-4aeb-8c58-285b046fbee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.000269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168a56-934b-4aeb-8c58-285b046fbee5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.010661 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1316/2639] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:30:32 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:30:33.015041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.025901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3270a53-89eb-4a85-937f-69b3d052ccb2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.031829 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.032756 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.033038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.033312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] PATH_INFO: `/v3/projects/6ba28de0da5c497cb500dac41ecb697d/users/0279f50d46794444afd38db3c4019ba4/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.049344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba28de0da5c497cb500dac41ecb697d, user_id=0279f50d46794444afd38db3c4019ba4, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.052127 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.067634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1324/2640] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:30:33 2021] PUT /identity/v3/projects/6ba28de0da5c497cb500dac41ecb697d/users/0279f50d46794444afd38db3c4019ba4/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:30:33.078125 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.078518 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.078807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.108992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] MFA Rules not processed for user `0279f50d46794444afd38db3c4019ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:30:33.110196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:33.178276 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1317/2641] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:30:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:30:33.183238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.248091 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205c291-9751-4b34-a4bf-1c44b1225002 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.253685 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.254402 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.254687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.254967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.255692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.257643 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.286921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1325/2642] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:30:33 2021] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:30:33.291229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.302072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7bfb4-1a1d-4630-8253-43dc4fdb153e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.362514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.363116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.363395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.363674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.364385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.366346 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.387886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1318/2643] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:30:33 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:30:33.392082 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.402629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5cef3-602f-45af-8c32-cc3660794513 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.407379 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.408044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.408321 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.408593 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.409340 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.410984 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.422555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1326/2644] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:30:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:30:33.426917 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.438353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284f596-474b-4179-b0c9-b44d70ea553d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.443553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.444438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.444720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.444993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] PATH_INFO: `/v3/projects/f0d83adf3d5048939fa0b2b309e8489c/users/0d99520ec2a44e7abddd7db24c629779/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.459814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d83adf3d5048939fa0b2b309e8489c, user_id=0d99520ec2a44e7abddd7db24c629779, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.462574 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.479365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1319/2645] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:30:33 2021] PUT /identity/v3/projects/f0d83adf3d5048939fa0b2b309e8489c/users/0d99520ec2a44e7abddd7db24c629779/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:30:33.483420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.494407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fab4-f233-43bc-93c4-9693f0952236 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.558523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb92e40-c519-49d4-b5ba-9628f8e624fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.559180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92e40-c519-49d4-b5ba-9628f8e624fc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.559463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92e40-c519-49d4-b5ba-9628f8e624fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.559741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92e40-c519-49d4-b5ba-9628f8e624fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.560502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb92e40-c519-49d4-b5ba-9628f8e624fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.562200 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb92e40-c519-49d4-b5ba-9628f8e624fc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.572507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1327/2646] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:30:33 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:30:33.576854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.587836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a1e74-298a-4a6b-bb38-89bf51870779 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.594758 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.595649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.595937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.596221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] PATH_INFO: `/v3/projects/f0d83adf3d5048939fa0b2b309e8489c/users/0d99520ec2a44e7abddd7db24c629779/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.598407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d83adf3d5048939fa0b2b309e8489c, user_id=0d99520ec2a44e7abddd7db24c629779, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.601117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.612811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1320/2647] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:30:33 2021] PUT /identity/v3/projects/f0d83adf3d5048939fa0b2b309e8489c/users/0d99520ec2a44e7abddd7db24c629779/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:30:33.624601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.624880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.625165 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.654416 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] MFA Rules not processed for user `0d99520ec2a44e7abddd7db24c629779`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:30:33.655648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:33.733490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1328/2648] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:30:33 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:30:33.745241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.747216 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:30:33.805345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e576-9fd7-477e-b565-c8ef67469f2a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.809312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.809962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.810272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.810552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:33.820196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:33.821750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:33.831962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1321/2649] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:33 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:30:33.910138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:30:33.920632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f833-6361-46b7-b3a3-f8b4405c89dd None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:30:33.925907 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a48ee9-b2d8-41d8-83d6-81037f654d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:30:33.927206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48ee9-b2d8-41d8-83d6-81037f654d0d service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:30:33.927889 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48ee9-b2d8-41d8-83d6-81037f654d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:30:33.928335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a48ee9-b2d8-41d8-83d6-81037f654d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:30:34.008244 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48ee9-b2d8-41d8-83d6-81037f654d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:30:34.009801 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a48ee9-b2d8-41d8-83d6-81037f654d0d service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:30:34.020325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1329/2650] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:30:33 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:15.663260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:15.729270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be214e67-8380-4bc0-bd04-9e1c0b50a8c8 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:15.735183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:15.736072 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:15.736359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:15.736633 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] PATH_INFO: `/v3/users/0279f50d46794444afd38db3c4019ba4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:15.737961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0279f50d46794444afd38db3c4019ba4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:15.739925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:15.801869 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0279f50d46794444afd38db3c4019ba4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:15.802630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0279f50d46794444afd38db3c4019ba4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:15.803273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0279f50d46794444afd38db3c4019ba4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:15.814979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0279f50d46794444afd38db3c4019ba4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:15.827095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0279f50d46794444afd38db3c4019ba4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:15.839949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1322/2651] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:15 2021] DELETE /identity/v3/users/0279f50d46794444afd38db3c4019ba4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:15.845409 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:15.845942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:15.845942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:15.864488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:15.866063 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:15.929316 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1330/2652] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:15.939821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:15.941456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:16.000976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342971-9d7d-47ea-a32f-5b229bc9d367 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:16.004711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:16.005389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:16.005660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:16.005941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:16.016838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:16.018361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:16.028995 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1323/2653] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:16.333538 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:16.336202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:16.350069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411505b-68c5-441d-a2a4-5aaa92604def None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:16.355318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:16.356373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:16.356657 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:16.356932 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] PATH_INFO: `/v3/projects/6ba28de0da5c497cb500dac41ecb697d` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:16.358152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba28de0da5c497cb500dac41ecb697d)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:16.360949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:16.409426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba28de0da5c497cb500dac41ecb697d', 'request_id': 'req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.416838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba28de0da5c497cb500dac41ecb697d', 'request_id': 'req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.422023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba28de0da5c497cb500dac41ecb697d', 'request_id': 'req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.433920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] The token cache is being invalidate because project 6ba28de0da5c497cb500dac41ecb697d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:16.434233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.434905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.436505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1331/2654] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:16 2021] DELETE /identity/v3/projects/6ba28de0da5c497cb500dac41ecb697d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:16.440867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:16.450580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e684b-5838-4ced-89c7-1857a1bf3cc5 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:16.507430 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:16.508348 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:16.508635 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:16.508907 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] PATH_INFO: `/v3/users/0d99520ec2a44e7abddd7db24c629779` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:16.510438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d99520ec2a44e7abddd7db24c629779)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:16.512503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:16.575659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d99520ec2a44e7abddd7db24c629779'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.576380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d99520ec2a44e7abddd7db24c629779'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.577040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d99520ec2a44e7abddd7db24c629779'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.587630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d99520ec2a44e7abddd7db24c629779'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.606201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-e78b9797-355f-4e48-93a5-8189c364b33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d99520ec2a44e7abddd7db24c629779'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:16.619160 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1324/2655] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:16 2021] DELETE /identity/v3/users/0d99520ec2a44e7abddd7db24c629779 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:16.889470 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:16.891069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:16.905789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3e8c-7dde-44ac-a7e7-0f488e1cd2f6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:16.964968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:16.965827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:16.966099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:16.966405 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] PATH_INFO: `/v3/projects/f0d83adf3d5048939fa0b2b309e8489c` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:16.967586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d83adf3d5048939fa0b2b309e8489c)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:16.969493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.018606 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d83adf3d5048939fa0b2b309e8489c', 'request_id': 'req-5a265a30-2527-4dc7-8546-8f715277e2b2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:17.029069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d83adf3d5048939fa0b2b309e8489c', 'request_id': 'req-5a265a30-2527-4dc7-8546-8f715277e2b2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:17.036033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d83adf3d5048939fa0b2b309e8489c', 'request_id': 'req-5a265a30-2527-4dc7-8546-8f715277e2b2'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:17.048135 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] The token cache is being invalidate because project f0d83adf3d5048939fa0b2b309e8489c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:17.048451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:17.049141 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5a265a30-2527-4dc7-8546-8f715277e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:17.050850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1332/2656] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:16 2021] DELETE /identity/v3/projects/f0d83adf3d5048939fa0b2b309e8489c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:17.057297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.057752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.057857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.077005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:17.078279 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:17.140038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1325/2657] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:17.148309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.148837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.149145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.168719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:17.169931 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:17.178425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1333/2658] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:17.182801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.193056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00522858-0d9c-4683-82ab-e3257a2d1886 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.200254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.200918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.201193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.201458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.202195 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:31:17.202538 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.204184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.216990 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1326/2659] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:31:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:31:17.223693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.235760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d2073-be5f-47ba-98dd-3a98d3edea29 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.241296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.241956 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.242236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.242511 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.243235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.245180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.280021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1334/2660] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:17.281352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.291938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38eded-94f0-41e5-94b2-285b89589bd2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.354020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.354815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.355164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.355469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.356154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.358223 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.381797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1327/2661] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:17.386871 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.403323 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae3663-4f67-4968-bfd7-935d29033b72 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.409989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.410687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.410967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.411243 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.411990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.413615 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.425121 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1335/2662] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:17.429337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.440146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504bf6-8896-4283-8fdc-0b1b01bfe120 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.446302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4642d06-87f5-4f65-9d83-6467df1294a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.446982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642d06-87f5-4f65-9d83-6467df1294a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.447260 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642d06-87f5-4f65-9d83-6467df1294a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.447535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4642d06-87f5-4f65-9d83-6467df1294a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.448328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642d06-87f5-4f65-9d83-6467df1294a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.451128 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4642d06-87f5-4f65-9d83-6467df1294a4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.462130 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1328/2663] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:17.466386 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.476815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaa26-9727-4596-bd36-26007515a717 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.481975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.482927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.483222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.483500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] PATH_INFO: `/v3/projects/bfcfca65647f4efa87f7d9a80210a657/users/42e69523b9314b86b8cc7790df8f1656/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.499565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcfca65647f4efa87f7d9a80210a657, user_id=42e69523b9314b86b8cc7790df8f1656, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.502476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.518233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1336/2664] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:17 2021] PUT /identity/v3/projects/bfcfca65647f4efa87f7d9a80210a657/users/42e69523b9314b86b8cc7790df8f1656/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:17.529543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.529829 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.530106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.558485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] MFA Rules not processed for user `42e69523b9314b86b8cc7790df8f1656`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:17.559956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:17.636803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1329/2665] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:17.643226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.722190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdeb43-4945-4ef0-8915-0733a2e7bdf8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.728346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.729035 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.729291 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.729564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.730432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.732358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.759641 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1337/2666] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:17.763772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.774580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a40747-f3b9-4fa6-8f63-139e88946fd2 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.842934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.843617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.843899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.844179 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.844905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.847523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.869969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1330/2667] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:17 2021] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:17.874692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.888879 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4058c5-ccd8-4449-8960-f9b8293419c4 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.895378 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.896256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.896633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.896923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.897727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.900186 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.912675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1338/2668] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:17.917054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:17.928093 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd6af-c5ea-4edb-815e-c65cb4440d5c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:17.934025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:17.935062 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:17.935344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:17.935623 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] PATH_INFO: `/v3/projects/12461b6579e6442f8a9a3854483637b3/users/84b6ec18078e43afa14955ba51f58f7e/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:17.958012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12461b6579e6442f8a9a3854483637b3, user_id=84b6ec18078e43afa14955ba51f58f7e, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:17.962406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:17.983442 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1331/2669] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:17 2021] PUT /identity/v3/projects/12461b6579e6442f8a9a3854483637b3/users/84b6ec18078e43afa14955ba51f58f7e/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:17.988294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:18.004138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8f4d9-94b5-471e-ab90-4073b1f89977 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:18.083963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6822-f42c-4ad5-a1c3-a3257ce03bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:18.085024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6822-f42c-4ad5-a1c3-a3257ce03bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:18.085522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6822-f42c-4ad5-a1c3-a3257ce03bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:18.085976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6822-f42c-4ad5-a1c3-a3257ce03bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:18.087221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d6822-f42c-4ad5-a1c3-a3257ce03bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:18.089867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d6822-f42c-4ad5-a1c3-a3257ce03bdb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:18.105632 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1339/2670] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:18.110202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:18.122641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42776-c818-49e7-bad1-e841e97da362 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:18.133791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:18.134883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:18.135168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:18.135405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] PATH_INFO: `/v3/projects/12461b6579e6442f8a9a3854483637b3/users/84b6ec18078e43afa14955ba51f58f7e/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:18.137851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12461b6579e6442f8a9a3854483637b3, user_id=84b6ec18078e43afa14955ba51f58f7e, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:18.143936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:18.158847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1332/2671] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:18 2021] PUT /identity/v3/projects/12461b6579e6442f8a9a3854483637b3/users/84b6ec18078e43afa14955ba51f58f7e/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:18.171588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:18.171977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:18.172368 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:18.207725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] MFA Rules not processed for user `84b6ec18078e43afa14955ba51f58f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:18.208977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:18.297883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1340/2672] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:18 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:18.313468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:18.316395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:18.387924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2252e9-0597-4278-9d8c-e9305a8f7f1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:18.392687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:18.393556 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:18.394117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:18.394431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:18.467879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:18.469545 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:18.480202 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1333/2673] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:18 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:24.163915 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:24.165364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:24.178620 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca1f48-624c-4ca3-99b5-ee94e8305991 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:24.183369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:24.184018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:24.184303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:24.184577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:24.194990 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:24.196453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:24.206753 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1341/2674] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:24 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:45.349968 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:45.351586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:45.440415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1cbd-633a-4f87-a149-561f5fcb2639 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:45.445220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:45.445919 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:45.446212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:45.446508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:45.448519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:45.513550 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:45.515101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:45.530150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1334/2675] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:48.854748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:48.856491 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:48.877531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc060-d94e-41c4-ac3f-0648de935094 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:48.883737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:48.885027 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:48.885415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:48.885834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] PATH_INFO: `/v3/users/b865802b111a42118b385d68fb89f352` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:48.887557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b865802b111a42118b385d68fb89f352)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:48.890525 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:48.941661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b865802b111a42118b385d68fb89f352'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:48.942364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b865802b111a42118b385d68fb89f352'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:48.943107 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b865802b111a42118b385d68fb89f352'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:48.954856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b865802b111a42118b385d68fb89f352'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:48.967397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b865802b111a42118b385d68fb89f352'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:48.980380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1342/2676] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:48 2021] DELETE /identity/v3/users/b865802b111a42118b385d68fb89f352 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:49.165100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.177394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1b2b-f1e1-4786-9ab5-392750e881c6 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.232442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.234214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:49.245319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.247314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.247597 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.247877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] PATH_INFO: `/v3/projects/9f86f93bf80849ffadb5e07891102ce5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.249468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f86f93bf80849ffadb5e07891102ce5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.251490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.298277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6ce3a-98d3-4c6a-8a7b-361645a75572 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.299404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f86f93bf80849ffadb5e07891102ce5', 'request_id': 'req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.307250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f86f93bf80849ffadb5e07891102ce5', 'request_id': 'req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.312836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f86f93bf80849ffadb5e07891102ce5', 'request_id': 'req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.323529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] The token cache is being invalidate because project 9f86f93bf80849ffadb5e07891102ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:49.323823 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.324470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-110ff9f0-d4eb-48e3-bfb8-7abf1d2ee426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.326010 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1335/2677] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:49 2021] DELETE /identity/v3/projects/9f86f93bf80849ffadb5e07891102ce5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:49.331716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea982-d27d-4d12-b647-25b6ad9d7415 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.331997 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea982-d27d-4d12-b647-25b6ad9d7415 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.332274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea982-d27d-4d12-b647-25b6ad9d7415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.350108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d16ea982-d27d-4d12-b647-25b6ad9d7415 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:49.351221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d16ea982-d27d-4d12-b647-25b6ad9d7415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:49.358216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.359113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.359398 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.359673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] PATH_INFO: `/v3/users/42e69523b9314b86b8cc7790df8f1656` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.360917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e69523b9314b86b8cc7790df8f1656)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.362908 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.410505 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1336/2678] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:49.416973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e69523b9314b86b8cc7790df8f1656'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.418044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e69523b9314b86b8cc7790df8f1656'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.418755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.419049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.419317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e69523b9314b86b8cc7790df8f1656'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.419459 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.431106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e69523b9314b86b8cc7790df8f1656'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.438735 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:49.439956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:49.444197 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-162979f9-e1cc-4545-8f12-51a1e48b0aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e69523b9314b86b8cc7790df8f1656'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:49.448247 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1337/2679] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:49.452423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.456965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1343/2680] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:49 2021] DELETE /identity/v3/users/42e69523b9314b86b8cc7790df8f1656 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:49.461319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48178f49-606d-40a3-b3cc-598e42c4013e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.461547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.461755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.462029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.478646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:49.480530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:49.525900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.526603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.526884 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.527162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.527921 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:31:49.528231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.529927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.542105 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1338/2681] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:31:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 16:31:49.546896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.551240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1344/2682] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:49.560975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f11ec8-3977-465d-84cb-28a376ec1c05 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.561589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.563099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:49.565730 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.566535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.566815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.567087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.567847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.569916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.600786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1339/2683] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:31:49.604290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.623810 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc0b05-8330-43d1-b6e3-cb32657317f8 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.668006 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444c293-7328-4b8e-9107-082e1c804103 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.671864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.672518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.672701 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.672806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.673061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.673370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.673656 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.673934 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.674679 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.676803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.683017 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.684528 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.694933 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1345/2684] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:31:49.704522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1340/2685] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:31:49.705729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.715709 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56792d-32ad-422e-b45b-e68fccf0c0fd service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.720476 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.721156 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.721441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.721721 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.722518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.724582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.736100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1346/2686] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:49.741237 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.751839 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e50c6-c31c-43e7-893b-ad7d8d5264c3 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.757642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebd181-a1b7-45a1-8b10-5fb2f219f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.758537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd181-a1b7-45a1-8b10-5fb2f219f78f admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.758847 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd181-a1b7-45a1-8b10-5fb2f219f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.759122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd181-a1b7-45a1-8b10-5fb2f219f78f admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.759916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebd181-a1b7-45a1-8b10-5fb2f219f78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.761625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebd181-a1b7-45a1-8b10-5fb2f219f78f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.774190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1341/2687] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:49 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:49.776949 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.787860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b56c8-2779-435b-9515-0d3043b5a918 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:49.795061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:49.796085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.796388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.796673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] PATH_INFO: `/v3/projects/6aea3f7f6a26439694278fb4dc7b4240/users/393365b9148545dd9312dcd3fb08699e/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.812999 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aea3f7f6a26439694278fb4dc7b4240, user_id=393365b9148545dd9312dcd3fb08699e, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:49.815727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:49.831662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1347/2688] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:49 2021] PUT /identity/v3/projects/6aea3f7f6a26439694278fb4dc7b4240/users/393365b9148545dd9312dcd3fb08699e/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:49.844440 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:49.844736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:49.845017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:49.873458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] MFA Rules not processed for user `393365b9148545dd9312dcd3fb08699e`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:49.874720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:49.939528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1342/2689] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:49.944223 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.968769 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:49.970349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.014948 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9100c0-3b6b-44b0-ba6c-c6aa4fe04bd9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.019904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.020893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.021346 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.021627 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.022373 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.024365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.037486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf8342-0da7-4bbc-a09e-1ca8a8a5e86d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.043841 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.044723 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.045021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.045385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] PATH_INFO: `/v3/projects/bfcfca65647f4efa87f7d9a80210a657` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.046654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcfca65647f4efa87f7d9a80210a657)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.048616 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.051420 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1348/2690] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:49 2021] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:50.055711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.095508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcfca65647f4efa87f7d9a80210a657', 'request_id': 'req-0b6b930e-c413-4b7a-ae43-64de9bfcff62'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.104040 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcfca65647f4efa87f7d9a80210a657', 'request_id': 'req-0b6b930e-c413-4b7a-ae43-64de9bfcff62'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.109525 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcfca65647f4efa87f7d9a80210a657', 'request_id': 'req-0b6b930e-c413-4b7a-ae43-64de9bfcff62'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.117585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb387a-603e-458a-aa2c-9d6c4310437d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.120949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] The token cache is being invalidate because project bfcfca65647f4efa87f7d9a80210a657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:50.121248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.121923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.123576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1343/2691] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:49 2021] DELETE /identity/v3/projects/bfcfca65647f4efa87f7d9a80210a657 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:50.127506 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.129070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.175521 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.176196 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.176475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.176868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.177586 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.179539 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.191945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b930e-c413-4b7a-ae43-64de9bfcff62 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.197736 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.198649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.198926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.199196 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] PATH_INFO: `/v3/users/84b6ec18078e43afa14955ba51f58f7e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.200414 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b6ec18078e43afa14955ba51f58f7e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.204119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1349/2692] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:50 2021] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:31:50.204269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.205175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.206831 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.218702 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63f4ca-9622-49f7-aaeb-12cb3aee24df admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.223843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.224619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.224904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.225175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.225958 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.227700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.238113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1350/2693] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:50.245126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.253153 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b6ec18078e43afa14955ba51f58f7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.253822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b6ec18078e43afa14955ba51f58f7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.254452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b6ec18078e43afa14955ba51f58f7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.254555 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfbcea-c0aa-4f42-be10-5ccbe0e79bf3 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.259302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.260228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.260502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.260771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] PATH_INFO: `/v3/projects/8ec21c38fec647359d8603b52205c38c/users/f6167894e7754f7cb0890ac810f55087/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.263122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b6ec18078e43afa14955ba51f58f7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.274929 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b6ec18078e43afa14955ba51f58f7e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.276033 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec21c38fec647359d8603b52205c38c, user_id=f6167894e7754f7cb0890ac810f55087, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.278764 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.286891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1344/2694] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:50 2021] DELETE /identity/v3/users/84b6ec18078e43afa14955ba51f58f7e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:50.295183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1351/2695] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:50 2021] PUT /identity/v3/projects/8ec21c38fec647359d8603b52205c38c/users/f6167894e7754f7cb0890ac810f55087/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:31:50.299270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.300846 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.364452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba463f3-82ee-464b-8eaa-ac80a0e68589 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.420559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7611df-570f-4d2f-a1b1-1920b09608c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.421244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7611df-570f-4d2f-a1b1-1920b09608c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.421526 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7611df-570f-4d2f-a1b1-1920b09608c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.421800 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7611df-570f-4d2f-a1b1-1920b09608c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.422590 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7611df-570f-4d2f-a1b1-1920b09608c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.424203 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7611df-570f-4d2f-a1b1-1920b09608c0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.435028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1345/2696] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:50 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:50.439234 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.449997 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d197c3-baa3-40f6-91b3-283b1efee6fe admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.454671 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.455563 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.455838 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.456106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] PATH_INFO: `/v3/projects/8ec21c38fec647359d8603b52205c38c/users/f6167894e7754f7cb0890ac810f55087/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.458242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec21c38fec647359d8603b52205c38c, user_id=f6167894e7754f7cb0890ac810f55087, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.460890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.471580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1352/2697] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:50 2021] PUT /identity/v3/projects/8ec21c38fec647359d8603b52205c38c/users/f6167894e7754f7cb0890ac810f55087/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:50.481936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.482265 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.482570 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.511731 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] MFA Rules not processed for user `f6167894e7754f7cb0890ac810f55087`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:50.512979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.558706 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.560519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.588393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1346/2698] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:50 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:50.599254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.600652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.646650 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f0f21-56b6-47e8-b50a-ac792e01a744 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.651412 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.652299 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.652582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.652856 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] PATH_INFO: `/v3/projects/12461b6579e6442f8a9a3854483637b3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.654073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12461b6579e6442f8a9a3854483637b3)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.656031 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.657005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc567b-cf80-46d4-b66d-185f1f4e433e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.662255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10698da-7082-453c-a668-33370143c201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.662903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10698da-7082-453c-a668-33370143c201 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.663181 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10698da-7082-453c-a668-33370143c201 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.663480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10698da-7082-453c-a668-33370143c201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.672640 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10698da-7082-453c-a668-33370143c201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.674080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10698da-7082-453c-a668-33370143c201 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.684169 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1347/2699] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:50 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:31:50.702965 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12461b6579e6442f8a9a3854483637b3', 'request_id': 'req-d813c07d-d708-4273-ba81-4b105599e630'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.710781 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12461b6579e6442f8a9a3854483637b3', 'request_id': 'req-d813c07d-d708-4273-ba81-4b105599e630'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.722547 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12461b6579e6442f8a9a3854483637b3', 'request_id': 'req-d813c07d-d708-4273-ba81-4b105599e630'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.734374 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] The token cache is being invalidate because project 12461b6579e6442f8a9a3854483637b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:50.734711 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.735519 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:50.737656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1353/2700] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:50 2021] DELETE /identity/v3/projects/12461b6579e6442f8a9a3854483637b3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:50.744647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33571a6d-b236-4bb0-9773-96217bde7ca8 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.744937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33571a6d-b236-4bb0-9773-96217bde7ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.745217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33571a6d-b236-4bb0-9773-96217bde7ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.757366 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.759188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.763909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-33571a6d-b236-4bb0-9773-96217bde7ca8 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:50.765101 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-33571a6d-b236-4bb0-9773-96217bde7ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.817489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c07d-d708-4273-ba81-4b105599e630 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.821501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.822150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.822467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.822744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.824624 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.825115 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1348/2701] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:50.834249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.834719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.835003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.853561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:50.854803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:50.863465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1349/2702] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:50.868593 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.877899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0155-2c0c-4228-835e-7e74b009a0de None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.883173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.883831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.884110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.884380 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.885120 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:31:50.885425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.887085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.888672 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.890136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.899302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1350/2703] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:31:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:31:50.899649 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1354/2704] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:50 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:31:50.903470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.913424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde6f45-264a-4113-8390-8c67bfbd3920 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:50.918569 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:50.919205 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:50.919496 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:50.919767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:50.920482 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:50.922441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:50.952075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1351/2705] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:50 2021] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:50.956653 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:50.968967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3785d-f935-4030-9e6f-dc3f596094c5 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.029229 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.029906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.030236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.030522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.031239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.033203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.057787 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1355/2706] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:50 2021] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:51.059606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.073481 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc38a-88bb-424e-832a-703f0d799177 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.079600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.080409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.080818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.081166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.082318 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.084558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.099220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1352/2707] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:51 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:51.103242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.113689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743260e-7d6b-4592-87ba-108e886fab9e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.119739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046f7a7-bc96-48e7-aad6-2532e83e3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.120464 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046f7a7-bc96-48e7-aad6-2532e83e3fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.120739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046f7a7-bc96-48e7-aad6-2532e83e3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.121008 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046f7a7-bc96-48e7-aad6-2532e83e3fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.121758 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046f7a7-bc96-48e7-aad6-2532e83e3fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.123419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046f7a7-bc96-48e7-aad6-2532e83e3fdf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.134725 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1356/2708] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:51.139401 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.151349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158470d-f8dd-4c0f-92a8-616ce686b121 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.157812 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.158734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.159016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.159291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] PATH_INFO: `/v3/projects/e29e9eeb237b4c16a2b83d63652683c1/users/8a83f8477c474f7eba53039c52798e46/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.176636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e9eeb237b4c16a2b83d63652683c1, user_id=8a83f8477c474f7eba53039c52798e46, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.179319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.200330 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1353/2709] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:51 2021] PUT /identity/v3/projects/e29e9eeb237b4c16a2b83d63652683c1/users/8a83f8477c474f7eba53039c52798e46/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:51.211365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.211662 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.211941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.242904 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] MFA Rules not processed for user `8a83f8477c474f7eba53039c52798e46`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:51.244138 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:51.317816 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1357/2710] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:51 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:51.322985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.391895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fc60-4cf0-4410-9b47-0a5f2b774c93 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.397933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.398682 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.399005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.399290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.400003 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.402020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.430891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1354/2711] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:51 2021] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:51.435364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.446596 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53fde8-bd6b-49f2-aca6-02676f829350 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.507732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.508422 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.508704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.508982 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.509732 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.511736 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.534813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1358/2712] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:51 2021] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:51.539124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.549707 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c446d-24dd-48ac-8629-cb9e86f52189 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.555508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.556158 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.556443 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.556715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.557477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.559286 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.570188 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1355/2713] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:51.574537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.586522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88354d-e66e-4cca-954d-d0694c66a352 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.594975 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.596262 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.596642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.597092 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] PATH_INFO: `/v3/projects/451c8515b3fc4a2a96ca4400f056dc2b/users/653d0ac9ed674bc0b40b90387663d87c/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.614367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c8515b3fc4a2a96ca4400f056dc2b, user_id=653d0ac9ed674bc0b40b90387663d87c, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.617381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.633901 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1359/2714] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:51 2021] PUT /identity/v3/projects/451c8515b3fc4a2a96ca4400f056dc2b/users/653d0ac9ed674bc0b40b90387663d87c/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:51.638150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.649302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58faf-fbbd-4905-96fd-aa1dc5f7ce40 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.706527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47b039-56f2-4cdb-8d59-f47b0d4200f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.707108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b039-56f2-4cdb-8d59-f47b0d4200f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.707415 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b039-56f2-4cdb-8d59-f47b0d4200f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.707669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b039-56f2-4cdb-8d59-f47b0d4200f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.708457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47b039-56f2-4cdb-8d59-f47b0d4200f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.710075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47b039-56f2-4cdb-8d59-f47b0d4200f8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.719989 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1356/2715] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:51 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:51.724896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.736870 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4108c-69d4-4686-8dd3-e3551bd13122 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.746081 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.747693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.748089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.748507 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] PATH_INFO: `/v3/projects/451c8515b3fc4a2a96ca4400f056dc2b/users/653d0ac9ed674bc0b40b90387663d87c/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.752112 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c8515b3fc4a2a96ca4400f056dc2b, user_id=653d0ac9ed674bc0b40b90387663d87c, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.756028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.767966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1360/2716] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:51 2021] PUT /identity/v3/projects/451c8515b3fc4a2a96ca4400f056dc2b/users/653d0ac9ed674bc0b40b90387663d87c/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:51.779088 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.779429 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.779741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.818896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] MFA Rules not processed for user `653d0ac9ed674bc0b40b90387663d87c`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:51.820150 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:51.893607 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1357/2717] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:51 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:51.905042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:51.958126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc120f1-cc71-4fd1-8b54-ba3e37b763b8 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:51.962673 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eebd5-3672-4303-892e-0eb96a47e9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:51.963322 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eebd5-3672-4303-892e-0eb96a47e9bd service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:51.963597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eebd5-3672-4303-892e-0eb96a47e9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:51.963866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eebd5-3672-4303-892e-0eb96a47e9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:51.974806 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eebd5-3672-4303-892e-0eb96a47e9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:51.976332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eebd5-3672-4303-892e-0eb96a47e9bd service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:51.988978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1361/2718] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:51 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:52.395355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:52.461240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c02cd-9400-4306-97be-1443cf34435a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:52.466300 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:52.467126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:52.467433 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:52.467685 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] PATH_INFO: `/v3/users/8a83f8477c474f7eba53039c52798e46` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:52.469079 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a83f8477c474f7eba53039c52798e46)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:52.471089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:52.519622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a83f8477c474f7eba53039c52798e46'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:52.520274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a83f8477c474f7eba53039c52798e46'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:52.520903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a83f8477c474f7eba53039c52798e46'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:52.530378 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a83f8477c474f7eba53039c52798e46'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:52.542696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a83f8477c474f7eba53039c52798e46'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:52.554528 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1358/2719] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:52 2021] DELETE /identity/v3/users/8a83f8477c474f7eba53039c52798e46 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:52.559382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:52.559655 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:52.559935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:52.577921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:52.579161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:52.637769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1362/2720] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:52.648468 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:52.650007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:52.708658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bd4e-b6ba-4d20-9455-b494bc5af7c6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:52.712687 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:52.713328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:52.713604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:52.713876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:52.723262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:52.724748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:52.734322 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1359/2721] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:31:53.024451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:53.026041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:53.040601 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7de1-bc50-4604-8d29-83c9cf610908 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:53.045453 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:53.046896 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.047384 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.047656 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] PATH_INFO: `/v3/projects/e29e9eeb237b4c16a2b83d63652683c1` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.048918 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29e9eeb237b4c16a2b83d63652683c1)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:53.050924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:53.099015 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29e9eeb237b4c16a2b83d63652683c1', 'request_id': 'req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.108117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29e9eeb237b4c16a2b83d63652683c1', 'request_id': 'req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.113864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29e9eeb237b4c16a2b83d63652683c1', 'request_id': 'req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.125349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] The token cache is being invalidate because project e29e9eeb237b4c16a2b83d63652683c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:53.125638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.126314 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.128304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1363/2722] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:53 2021] DELETE /identity/v3/projects/e29e9eeb237b4c16a2b83d63652683c1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:53.133425 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:53.148471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d10b-f370-4239-9220-96fb3b6f7c27 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:53.206384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:53.207258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.207639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.207788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] PATH_INFO: `/v3/users/653d0ac9ed674bc0b40b90387663d87c` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.209217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=653d0ac9ed674bc0b40b90387663d87c)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:53.211178 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:53.268356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653d0ac9ed674bc0b40b90387663d87c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.269061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653d0ac9ed674bc0b40b90387663d87c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.269772 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653d0ac9ed674bc0b40b90387663d87c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.279935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653d0ac9ed674bc0b40b90387663d87c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.293389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-f998a0b9-c766-4aba-a0ef-817c5b98a63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653d0ac9ed674bc0b40b90387663d87c'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.305849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1360/2723] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:31:53 2021] DELETE /identity/v3/users/653d0ac9ed674bc0b40b90387663d87c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:53.583458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:53.585190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:53.599330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d3df-5f8c-4eb6-adad-91e40567b9a1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:53.673913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:53.674877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.675101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.675377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] PATH_INFO: `/v3/projects/451c8515b3fc4a2a96ca4400f056dc2b` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.677740 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451c8515b3fc4a2a96ca4400f056dc2b)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:53.679910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:53.728526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451c8515b3fc4a2a96ca4400f056dc2b', 'request_id': 'req-55754afb-8c74-45d9-9cab-f00e2fff0073'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.737248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451c8515b3fc4a2a96ca4400f056dc2b', 'request_id': 'req-55754afb-8c74-45d9-9cab-f00e2fff0073'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.743893 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451c8515b3fc4a2a96ca4400f056dc2b', 'request_id': 'req-55754afb-8c74-45d9-9cab-f00e2fff0073'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.756295 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] The token cache is being invalidate because project 451c8515b3fc4a2a96ca4400f056dc2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:31:53.756591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.757312 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-55754afb-8c74-45d9-9cab-f00e2fff0073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:31:53.759193 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1364/2724] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:31:53 2021] DELETE /identity/v3/projects/451c8515b3fc4a2a96ca4400f056dc2b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:53.765354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.765818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.765904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.785923 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:53.787113 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:53.852476 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1361/2725] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:31:53.860325 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.860611 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.860886 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.881734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:53.883030 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:53.891590 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1365/2726] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:53.896301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:53.906290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540993-112b-45bf-8f8d-f0fda0c1841f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:53.911584 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:53.912273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.912555 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.912890 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.913649 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:31:53.913958 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:53.915638 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:53.927660 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1362/2727] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:31:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:31:53.932365 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:53.941704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d5629-7781-48b4-80da-9f4400e5fca5 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:53.946667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:53.947324 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:53.947602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:53.947878 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:53.948600 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:53.950526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:53.977254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1366/2728] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:53 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:53.981560 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:53.992304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7f86e-b99d-4fa6-b96b-d710e65328bf admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.059145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.060031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.060395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.060807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.061941 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.064976 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.087573 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1363/2729] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:53 2021] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:54.091950 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.102794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990918d8-dbd8-423e-a56d-6e315a17072f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.108517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.109175 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.109461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.109738 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.110522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.112254 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.123131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1367/2730] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:54.127212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.138426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb976c0-5f39-4739-84de-fe8dda44c3c6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.144126 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf279538-d7fb-4a00-afc2-a54662058cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.144824 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279538-d7fb-4a00-afc2-a54662058cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.145108 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279538-d7fb-4a00-afc2-a54662058cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.145524 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279538-d7fb-4a00-afc2-a54662058cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.146343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf279538-d7fb-4a00-afc2-a54662058cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.148038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf279538-d7fb-4a00-afc2-a54662058cb6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.159183 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1364/2731] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:31:54.163921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.174737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d8275-1f57-456b-92e8-417aa9c02f9c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.181318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.182290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.182556 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.182827 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] PATH_INFO: `/v3/projects/cd374a16aa114437b60583bf4541a068/users/1c1cb6aa3b614dc68ede0f75be3d4019/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.199347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd374a16aa114437b60583bf4541a068, user_id=1c1cb6aa3b614dc68ede0f75be3d4019, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.202028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.218187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1368/2732] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:54 2021] PUT /identity/v3/projects/cd374a16aa114437b60583bf4541a068/users/1c1cb6aa3b614dc68ede0f75be3d4019/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:54.229119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.229411 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.229693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.258658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] MFA Rules not processed for user `1c1cb6aa3b614dc68ede0f75be3d4019`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:54.259985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:54.326100 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1365/2733] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:54 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:54.330716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.392822 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadc2a1-75f1-4e9d-8e04-5a02f19a26ad admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.397837 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.398532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.398815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.399089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.399811 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.401749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.436663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1369/2734] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:31:54 2021] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:54.441166 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.453522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f283ab-0949-492f-a919-d56bcde56e4a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.518197 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.518859 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.519138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.519406 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.520134 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.522090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.544982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1366/2735] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:31:54 2021] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:31:54.549145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.559942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eba45-ae16-446b-a2e6-2ac21e019304 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.565380 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.566042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.566355 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.566633 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.567390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.569069 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.579890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1370/2736] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:54.584375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.595257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6681ac-3e64-4bea-8110-b1921485a6b4 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.600251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.601140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.601426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.601737 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] PATH_INFO: `/v3/projects/14eece1476194de0b4dea496eb5c497f/users/25299b5ba51b447fb8f5c2189971aeb3/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.618541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eece1476194de0b4dea496eb5c497f, user_id=25299b5ba51b447fb8f5c2189971aeb3, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.621262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.637606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1367/2737] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:54 2021] PUT /identity/v3/projects/14eece1476194de0b4dea496eb5c497f/users/25299b5ba51b447fb8f5c2189971aeb3/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:54.641726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.651791 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1a84-0149-43cf-bfc8-c44ce1f6186b admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.708251 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0974b2-99e1-4872-a73a-c53253fa6a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.708923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0974b2-99e1-4872-a73a-c53253fa6a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.709207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0974b2-99e1-4872-a73a-c53253fa6a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.709488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0974b2-99e1-4872-a73a-c53253fa6a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.710318 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0974b2-99e1-4872-a73a-c53253fa6a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.712059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0974b2-99e1-4872-a73a-c53253fa6a30 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.722179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1371/2738] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:31:54 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:31:54.726716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.737549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586172a-7820-4820-80c5-33597b43d114 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.743609 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.744484 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.744763 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.745034 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] PATH_INFO: `/v3/projects/14eece1476194de0b4dea496eb5c497f/users/25299b5ba51b447fb8f5c2189971aeb3/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.747218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eece1476194de0b4dea496eb5c497f, user_id=25299b5ba51b447fb8f5c2189971aeb3, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:54.749852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:54.761693 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1368/2739] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:31:54 2021] PUT /identity/v3/projects/14eece1476194de0b4dea496eb5c497f/users/25299b5ba51b447fb8f5c2189971aeb3/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:31:54.773846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.774134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.774450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:54.804678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] MFA Rules not processed for user `25299b5ba51b447fb8f5c2189971aeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:31:54.805925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:54.883942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1372/2740] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:31:54 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:31:54.898457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:31:54.900955 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:31:54.970782 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a447a-c4e4-47ae-a1c7-66ce58c7ed4d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:31:54.975984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:31:54.976655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:31:54.976950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:31:54.977353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:31:55.035596 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:31:55.037060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:31:55.047595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1369/2741] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:31:54 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:00.313478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:00.327236 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973d8e-d0f9-4055-84bf-c1dc3205f3cc None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:00.331770 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cab78-2ece-4f62-a80c-f67296e4595c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:00.332449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cab78-2ece-4f62-a80c-f67296e4595c service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:00.332704 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cab78-2ece-4f62-a80c-f67296e4595c service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:00.332960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cab78-2ece-4f62-a80c-f67296e4595c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:00.343459 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cab78-2ece-4f62-a80c-f67296e4595c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:00.344906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cab78-2ece-4f62-a80c-f67296e4595c service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:00.354862 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1373/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:00 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:01.132428 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:01.133947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:01.203149 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eba54-19cb-42ce-94d1-b9922e36fab7 service cinder] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:01.208931 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:01.209795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:01.210073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:01.210385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] PATH_INFO: `/v3/users/393365b9148545dd9312dcd3fb08699e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:01.211671 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393365b9148545dd9312dcd3fb08699e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:01.213595 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:01.268768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393365b9148545dd9312dcd3fb08699e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.269431 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393365b9148545dd9312dcd3fb08699e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.270044 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393365b9148545dd9312dcd3fb08699e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.279379 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393365b9148545dd9312dcd3fb08699e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.290646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393365b9148545dd9312dcd3fb08699e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.306838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1370/2743] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:01 2021] DELETE /identity/v3/users/393365b9148545dd9312dcd3fb08699e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:01.312044 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:01.312334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:01.312613 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:01.334396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:01.335616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:01.403433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1374/2744] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:01.416747 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:01.418390 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:01.475060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc92262-d798-4362-b660-90cd3cb858c7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:01.479882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:01.480441 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:01.480725 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:01.481001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:01.491999 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:01.493477 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:01.503767 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1371/2745] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:01.789150 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:01.791621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:01.811097 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08670df1-c2ef-4ff2-b1f4-69a6420d7c68 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:01.818621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:01.819571 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:01.819968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:01.820249 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] PATH_INFO: `/v3/projects/6aea3f7f6a26439694278fb4dc7b4240` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:01.821501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aea3f7f6a26439694278fb4dc7b4240)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:01.823693 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:01.873898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aea3f7f6a26439694278fb4dc7b4240', 'request_id': 'req-de964ba4-5975-4117-97a2-026ff7b7e462'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.881640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aea3f7f6a26439694278fb4dc7b4240', 'request_id': 'req-de964ba4-5975-4117-97a2-026ff7b7e462'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.888245 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aea3f7f6a26439694278fb4dc7b4240', 'request_id': 'req-de964ba4-5975-4117-97a2-026ff7b7e462'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.903841 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] The token cache is being invalidate because project 6aea3f7f6a26439694278fb4dc7b4240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:01.904205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.904875 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:01.906609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1375/2746] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:01 2021] DELETE /identity/v3/projects/6aea3f7f6a26439694278fb4dc7b4240 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:01.910643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:01.921226 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368d618-f0a4-425d-a80e-c406daefa2a6 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:01.978186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:01.979201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:01.979609 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:01.980180 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] PATH_INFO: `/v3/users/f6167894e7754f7cb0890ac810f55087` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:01.982356 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6167894e7754f7cb0890ac810f55087)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:01.984849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.059655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6167894e7754f7cb0890ac810f55087'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.060340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6167894e7754f7cb0890ac810f55087'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.061083 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6167894e7754f7cb0890ac810f55087'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.070592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6167894e7754f7cb0890ac810f55087'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.082909 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-77e36190-0f54-429f-b020-ecd1d86e6817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6167894e7754f7cb0890ac810f55087'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.096016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1372/2747] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:01 2021] DELETE /identity/v3/users/f6167894e7754f7cb0890ac810f55087 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:02.367332 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.368936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:02.386071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964ba4-5975-4117-97a2-026ff7b7e462 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.458320 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.459188 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.459492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.459789 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] PATH_INFO: `/v3/projects/8ec21c38fec647359d8603b52205c38c` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.461050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec21c38fec647359d8603b52205c38c)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.463032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.521661 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec21c38fec647359d8603b52205c38c', 'request_id': 'req-0af6a123-017b-4eb7-99aa-6fcba02baf2c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.533505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec21c38fec647359d8603b52205c38c', 'request_id': 'req-0af6a123-017b-4eb7-99aa-6fcba02baf2c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.542516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec21c38fec647359d8603b52205c38c', 'request_id': 'req-0af6a123-017b-4eb7-99aa-6fcba02baf2c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.553977 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] The token cache is being invalidate because project 8ec21c38fec647359d8603b52205c38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:02.554288 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.554951 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-0af6a123-017b-4eb7-99aa-6fcba02baf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:02.556550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1376/2748] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:02 2021] DELETE /identity/v3/projects/8ec21c38fec647359d8603b52205c38c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:32:02.566966 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.567457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.567457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.585636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:02.586881 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:02.645407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1373/2749] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:02.656865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.657154 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.657433 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.677096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:02.678377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:02.686960 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1377/2750] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:02.691294 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.701639 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3b3f-46d1-48e9-b300-eb520aa1b6fe None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.706950 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.707611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.707938 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.708217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.708954 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:32:02.709258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.710908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.722855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1374/2751] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:32:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:32:02.727414 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.737010 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbef75-1781-41f9-9a32-fb452760a50e None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.742514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.743162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.743455 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.743724 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.744431 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.746490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.778343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1378/2752] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:02 2021] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:02.782598 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.792855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e173e-c1fb-4c3e-b684-ad857c1d0e29 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.849899 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.850547 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.850831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.851132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.851859 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.853818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.875912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1375/2753] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:02 2021] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:32:02.880276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.891019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ec03-f2e8-4369-a26e-3ac825493eab admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.896099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.896790 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.897073 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.897350 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.898114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.899767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.910558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1379/2754] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:02.916218 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.932347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4db8b-fa3a-4818-aedf-942ff5cf8a90 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.938603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dd5db-297d-4ca4-bdcd-8c5d2faaba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.939291 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd5db-297d-4ca4-bdcd-8c5d2faaba00 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.939579 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd5db-297d-4ca4-bdcd-8c5d2faaba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.939834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd5db-297d-4ca4-bdcd-8c5d2faaba00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.940613 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dd5db-297d-4ca4-bdcd-8c5d2faaba00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.942296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dd5db-297d-4ca4-bdcd-8c5d2faaba00 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:02.954129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1376/2755] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:32:02.958068 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:02.969549 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb372569-34c2-4c0d-aa26-479e36b21611 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:02.974602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:02.975481 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:02.975767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:02.976037 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] PATH_INFO: `/v3/projects/2ca8925c1c7049debac2355a4425e885/users/afeb589535f44eb598f77ea6b3b9bb64/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:02.991866 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8925c1c7049debac2355a4425e885, user_id=afeb589535f44eb598f77ea6b3b9bb64, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:02.994557 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:03.011006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1380/2756] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:02 2021] PUT /identity/v3/projects/2ca8925c1c7049debac2355a4425e885/users/afeb589535f44eb598f77ea6b3b9bb64/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:03.016620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290246-713b-40ed-b829-30e3ca3741d5 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:03.016914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290246-713b-40ed-b829-30e3ca3741d5 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:03.017191 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290246-713b-40ed-b829-30e3ca3741d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:03.037091 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-86290246-713b-40ed-b829-30e3ca3741d5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:03.038493 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-86290246-713b-40ed-b829-30e3ca3741d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:03.100857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1377/2757] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:03.114235 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:03.116358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:03.175751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4ae4-ed4a-43c8-a7a4-785ab44a8e50 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:03.180588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:03.181265 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:03.181541 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:03.181817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:03.193609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:03.195868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:03.207307 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1381/2758] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:03.842913 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:03.843389 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:03.843490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:03.872369 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] MFA Rules not processed for user `afeb589535f44eb598f77ea6b3b9bb64`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:03.873604 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:03.944056 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1378/2759] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:03 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:03.949468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:03.959865 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc9670-8635-441a-af5b-eabe8248e92e service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:03.965439 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:03.966040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:03.966358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:03.966638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:03.967354 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:03.969328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:03.996767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1382/2760] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:03 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:04.001327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:04.013277 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d3b2e-c41f-4d7e-bbac-bc96487b27b1 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:04.078080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:04.078788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:04.079073 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:04.079350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:04.080152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:04.081978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:04.109935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1379/2761] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:04 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:04.111159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:04.122772 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08741f-dc2e-4a70-a897-c310c1b94db2 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:04.128072 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:04.128980 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:04.129966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:04.129966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:04.130451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:04.132616 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:04.148562 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1383/2762] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:04 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:04.154742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:04.165726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c270-2e0f-47fd-ab5e-3075aad25efc admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:04.171117 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:04.172258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:04.172533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:04.172805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] PATH_INFO: `/v3/projects/a4739349815d48c8b7953c5e26e4bd75/users/54dc376d2bdd4c759e4e6b454723ea26/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:04.188765 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4739349815d48c8b7953c5e26e4bd75, user_id=54dc376d2bdd4c759e4e6b454723ea26, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:04.191475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:04.212137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1380/2763] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:04 2021] PUT /identity/v3/projects/a4739349815d48c8b7953c5e26e4bd75/users/54dc376d2bdd4c759e4e6b454723ea26/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:32:04.216353 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:04.226987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efe14-c7bb-4e86-99e8-bc426ade2579 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:04.284604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251897fd-066b-4f34-a513-eefa4004cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:04.285300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251897fd-066b-4f34-a513-eefa4004cbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:04.285576 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251897fd-066b-4f34-a513-eefa4004cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:04.285839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251897fd-066b-4f34-a513-eefa4004cbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:04.286647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251897fd-066b-4f34-a513-eefa4004cbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:04.288300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251897fd-066b-4f34-a513-eefa4004cbe9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:04.298182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1384/2764] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:04 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:04.302480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:04.315027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c8145-30b6-4055-8af9-28a0740698a9 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:04.320129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:04.321078 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:04.321351 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:04.321629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] PATH_INFO: `/v3/projects/a4739349815d48c8b7953c5e26e4bd75/users/54dc376d2bdd4c759e4e6b454723ea26/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:04.323780 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4739349815d48c8b7953c5e26e4bd75, user_id=54dc376d2bdd4c759e4e6b454723ea26, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:04.326509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:04.338182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1381/2765] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:04 2021] PUT /identity/v3/projects/a4739349815d48c8b7953c5e26e4bd75/users/54dc376d2bdd4c759e4e6b454723ea26/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:04.964882 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:04.966095 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:04.966635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:05.001125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] MFA Rules not processed for user `54dc376d2bdd4c759e4e6b454723ea26`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:05.002522 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:05.073240 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1385/2766] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:04 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:05.083553 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:05.085469 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:05.143804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436624b0-045f-43f8-906f-72c8081c0c5a admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:05.148032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf54f-9744-465f-9630-6ad30721ba52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:05.148771 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf54f-9744-465f-9630-6ad30721ba52 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:05.149060 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf54f-9744-465f-9630-6ad30721ba52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:05.149357 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf54f-9744-465f-9630-6ad30721ba52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:05.207935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf54f-9744-465f-9630-6ad30721ba52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:05.209432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf54f-9744-465f-9630-6ad30721ba52 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:05.219644 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1382/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:05 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:05.228542 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:05.230319 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:05.293580 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b36f8-3b7f-49d8-a9b9-01eea7a78923 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:05.298336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:05.299221 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:05.299494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:05.299762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] PATH_INFO: `/v3/users/1c1cb6aa3b614dc68ede0f75be3d4019` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:05.301021 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1cb6aa3b614dc68ede0f75be3d4019)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:05.302989 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:05.352762 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1cb6aa3b614dc68ede0f75be3d4019'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.353534 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1cb6aa3b614dc68ede0f75be3d4019'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.354169 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1cb6aa3b614dc68ede0f75be3d4019'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.363637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1cb6aa3b614dc68ede0f75be3d4019'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.376451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1cb6aa3b614dc68ede0f75be3d4019'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.389552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1386/2768] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:05 2021] DELETE /identity/v3/users/1c1cb6aa3b614dc68ede0f75be3d4019 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:05.394293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:05.394576 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:05.394879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:05.412467 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:05.413960 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:05.492367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1383/2769] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:05.503895 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:05.506968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:05.567803 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e306a-eb5f-465a-8cbd-7d4dfe35be0c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:05.571526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:05.572183 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:05.572468 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:05.572747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:05.582892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:05.584382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:05.594447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1387/2770] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 10 16:32:05.868985 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:05.870692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:05.886341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e4cf8-3a04-410b-a2a5-8c617cd1390a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:05.891867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:05.893090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:05.893444 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:05.893925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] PATH_INFO: `/v3/projects/cd374a16aa114437b60583bf4541a068` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:05.895402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd374a16aa114437b60583bf4541a068)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:05.897331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:05.950082 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd374a16aa114437b60583bf4541a068', 'request_id': 'req-35589839-28d6-4973-b17d-218fb60a24c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.960546 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd374a16aa114437b60583bf4541a068', 'request_id': 'req-35589839-28d6-4973-b17d-218fb60a24c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.966659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd374a16aa114437b60583bf4541a068', 'request_id': 'req-35589839-28d6-4973-b17d-218fb60a24c5'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.978087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] The token cache is being invalidate because project cd374a16aa114437b60583bf4541a068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:05.978402 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.979084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:05.980802 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1384/2771] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:05 2021] DELETE /identity/v3/projects/cd374a16aa114437b60583bf4541a068 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:05.985028 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:05.995425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42db26c-cd2f-4696-b97c-b2ff03b9829c service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.057004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.058303 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.058644 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.058922 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] PATH_INFO: `/v3/users/25299b5ba51b447fb8f5c2189971aeb3` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.060974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25299b5ba51b447fb8f5c2189971aeb3)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.064050 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.117623 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25299b5ba51b447fb8f5c2189971aeb3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.118359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25299b5ba51b447fb8f5c2189971aeb3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.119000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25299b5ba51b447fb8f5c2189971aeb3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.127938 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25299b5ba51b447fb8f5c2189971aeb3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.140308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25299b5ba51b447fb8f5c2189971aeb3'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.153480 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1388/2772] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:05 2021] DELETE /identity/v3/users/25299b5ba51b447fb8f5c2189971aeb3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:06.437255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.438877 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:06.452024 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35589839-28d6-4973-b17d-218fb60a24c5 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.509427 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.510297 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.510612 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.510886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] PATH_INFO: `/v3/projects/14eece1476194de0b4dea496eb5c497f` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.512262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eece1476194de0b4dea496eb5c497f)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.514270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.564119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eece1476194de0b4dea496eb5c497f', 'request_id': 'req-0e045d69-17c3-4733-bac2-e94993dfc96f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.565786 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.567415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:06.572327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eece1476194de0b4dea496eb5c497f', 'request_id': 'req-0e045d69-17c3-4733-bac2-e94993dfc96f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.578190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eece1476194de0b4dea496eb5c497f', 'request_id': 'req-0e045d69-17c3-4733-bac2-e94993dfc96f'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.589964 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] The token cache is being invalidate because project 14eece1476194de0b4dea496eb5c497f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:06.590304 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.591048 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0e045d69-17c3-4733-bac2-e94993dfc96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:06.592712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1385/2773] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:06 2021] DELETE /identity/v3/projects/14eece1476194de0b4dea496eb5c497f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:32:06.599352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce3cdb-cffc-4b5b-aebf-f1540f012f01 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.599641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce3cdb-cffc-4b5b-aebf-f1540f012f01 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.599914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce3cdb-cffc-4b5b-aebf-f1540f012f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.618807 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-88ce3cdb-cffc-4b5b-aebf-f1540f012f01 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:06.620077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-88ce3cdb-cffc-4b5b-aebf-f1540f012f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:06.627347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff7f0-9c0d-46a4-b1d9-09210bdceda5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.675418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.676093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.676408 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.676688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.678575 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:06.679192 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1386/2774] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:06.687904 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.688199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.688479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.706814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:06.708144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:06.717485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1387/2775] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:06.722144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.731715 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3db1-3cc3-4a36-af1f-fc019c1baf2e None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.736586 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.737258 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.737578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.737861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.738663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:32:06.738975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.740902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.744608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.746176 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.752361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1388/2776] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:32:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 10 16:32:06.756202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1389/2777] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:06 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:06.756744 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.766786 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c845-1f25-4aaf-a47a-e1c15a2cff1c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.771752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.772471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.772820 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.773182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.773891 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.775822 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.803739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1389/2778] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:06 2021] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:32:06.807988 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.818734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29492a-7af9-4d01-b72e-916f7c3fa213 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.876344 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.877039 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.877327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.877605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.878425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.880370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.906502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1390/2779] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:06 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:06.907947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.918795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafdfcb-bcec-461c-92fa-ab65f3f9b4cb admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.924269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.925066 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.925445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.925906 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.926761 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.928438 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.940658 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1390/2780] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:06.945845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.959016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5a51-4128-456a-a112-0160c0100954 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.964099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d5567-8864-47c0-879e-ee917a6578d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:06.964773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d5567-8864-47c0-879e-ee917a6578d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:06.965054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d5567-8864-47c0-879e-ee917a6578d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:06.965327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d5567-8864-47c0-879e-ee917a6578d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:06.966077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d5567-8864-47c0-879e-ee917a6578d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:06.967757 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d5567-8864-47c0-879e-ee917a6578d5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:06.978305 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1391/2781] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:06.982861 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:06.993273 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa912d8b-df7a-4408-a86b-4fe70d251710 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:06.999764 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:07.001705 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:07.001979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:07.002303 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] PATH_INFO: `/v3/projects/dd91744ffae047abb2a9ddba07ccd1f5/users/fb7effbc90c54234ba6e1fdf5d30a550/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:07.019036 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd91744ffae047abb2a9ddba07ccd1f5, user_id=fb7effbc90c54234ba6e1fdf5d30a550, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:07.021646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:07.040587 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1391/2782] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:06 2021] PUT /identity/v3/projects/dd91744ffae047abb2a9ddba07ccd1f5/users/fb7effbc90c54234ba6e1fdf5d30a550/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:32:07.052336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:07.052813 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:07.053106 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:07.085051 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] MFA Rules not processed for user `fb7effbc90c54234ba6e1fdf5d30a550`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:07.086400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:07.156233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1392/2783] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:07 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:07.167567 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:07.169605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:07.226949 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d812d-0b17-4a53-b9e1-fcf768ec1f21 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:07.231011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3aa4e-65bd-4470-b58c-0c916a777f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:07.231654 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3aa4e-65bd-4470-b58c-0c916a777f05 service cinder] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:07.231933 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3aa4e-65bd-4470-b58c-0c916a777f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:07.232208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3aa4e-65bd-4470-b58c-0c916a777f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:07.242625 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3aa4e-65bd-4470-b58c-0c916a777f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:07.244071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3aa4e-65bd-4470-b58c-0c916a777f05 service cinder] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:07.253409 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1392/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:07 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:07.276678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:07.347759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd244d1-998d-4762-ad94-bd9ac9603538 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:07.353199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:07.354071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:07.354503 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:07.354767 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] PATH_INFO: `/v3/users/fb7effbc90c54234ba6e1fdf5d30a550` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:07.356074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7effbc90c54234ba6e1fdf5d30a550)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:07.358018 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:07.411517 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7effbc90c54234ba6e1fdf5d30a550'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:07.412202 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7effbc90c54234ba6e1fdf5d30a550'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:07.412853 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7effbc90c54234ba6e1fdf5d30a550'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:07.421328 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7effbc90c54234ba6e1fdf5d30a550'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:07.433667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7effbc90c54234ba6e1fdf5d30a550'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:07.445779 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1393/2785] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:07 2021] DELETE /identity/v3/users/fb7effbc90c54234ba6e1fdf5d30a550 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:07.452927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489f71-389e-47c5-a729-9997c188306d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:07.453403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489f71-389e-47c5-a729-9997c188306d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:07.453488 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31489f71-389e-47c5-a729-9997c188306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:07.472951 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-31489f71-389e-47c5-a729-9997c188306d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:07.474182 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-31489f71-389e-47c5-a729-9997c188306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:07.532631 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1393/2786] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:07.543077 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:07.544582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:07.617162 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18e5e-d752-4a1b-8a27-9319dbdadfca admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:07.623105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a6481-9884-4248-b4f3-1fd9250a33a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:07.624083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a6481-9884-4248-b4f3-1fd9250a33a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:07.624501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a6481-9884-4248-b4f3-1fd9250a33a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:07.624898 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a6481-9884-4248-b4f3-1fd9250a33a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:07.637395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a6481-9884-4248-b4f3-1fd9250a33a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:07.638880 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a6481-9884-4248-b4f3-1fd9250a33a9 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:07.648510 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1394/2787] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:08.179795 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31489f71-389e-47c5-a729-9997c188306d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.181668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-31489f71-389e-47c5-a729-9997c188306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:08.200796 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31489f71-389e-47c5-a729-9997c188306d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.206186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.207250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.207423 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.207742 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] PATH_INFO: `/v3/projects/dd91744ffae047abb2a9ddba07ccd1f5` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.209146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd91744ffae047abb2a9ddba07ccd1f5)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.211071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.261683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd91744ffae047abb2a9ddba07ccd1f5', 'request_id': 'req-836216ff-afe5-40b7-9d52-32774d9d321d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:08.271620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd91744ffae047abb2a9ddba07ccd1f5', 'request_id': 'req-836216ff-afe5-40b7-9d52-32774d9d321d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:08.282721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd91744ffae047abb2a9ddba07ccd1f5', 'request_id': 'req-836216ff-afe5-40b7-9d52-32774d9d321d'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:08.291119 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] The token cache is being invalidate because project dd91744ffae047abb2a9ddba07ccd1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:08.291407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:08.292333 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-836216ff-afe5-40b7-9d52-32774d9d321d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:08.293905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1394/2788] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:08 2021] DELETE /identity/v3/projects/dd91744ffae047abb2a9ddba07ccd1f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:08.302131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.302668 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.302775 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.321120 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:08.322397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:08.384419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1395/2789] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:08.393663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.393945 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.394269 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.413875 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:08.415154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:08.424992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1395/2790] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:08.429155 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.439691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0185c-fb85-47e0-b164-2c76c36228ee None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.444765 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.445413 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.445690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.445967 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.446749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:32:08.447053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.448720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.460676 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1396/2791] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:32:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:32:08.465231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.475338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395f10-b7c8-4c98-b954-4ba811b4564d None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.481007 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.481666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.481947 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.482779 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.483498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.485533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.517109 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1396/2792] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:08 2021] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:08.518334 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.529013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2831f7-10e6-464a-bc8d-420b504b8bcf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.595699 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.596626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.596920 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.597248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.598333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.601390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.627016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1397/2793] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:08 2021] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:32:08.631370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.641984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb041-0636-4d53-b315-10316c544da2 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.647063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.647714 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.647993 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.648284 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.649032 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.650681 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.662337 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1397/2794] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:32:08.666588 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.677144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67aa91-03bf-4e19-9753-2d25faef7bcb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.682114 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68aff7-6ea3-4b3c-ab35-6d21003bc9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.682992 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68aff7-6ea3-4b3c-ab35-6d21003bc9dc admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.683281 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68aff7-6ea3-4b3c-ab35-6d21003bc9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.683559 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68aff7-6ea3-4b3c-ab35-6d21003bc9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.684317 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68aff7-6ea3-4b3c-ab35-6d21003bc9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.685917 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68aff7-6ea3-4b3c-ab35-6d21003bc9dc admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.696019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1398/2795] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:08.700085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.710452 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa1e4d-635f-4442-b34e-3ef8558c307b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.715813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.716697 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.716981 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.717255 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] PATH_INFO: `/v3/projects/cb1daf2d99b74460bbd97a9e0b7854fc/users/08f2f94c57ce4d2a907db09a7e1398b4/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.732302 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1daf2d99b74460bbd97a9e0b7854fc, user_id=08f2f94c57ce4d2a907db09a7e1398b4, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.735017 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.750843 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1398/2796] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:08 2021] PUT /identity/v3/projects/cb1daf2d99b74460bbd97a9e0b7854fc/users/08f2f94c57ce4d2a907db09a7e1398b4/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:08.755921 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc8189-f032-4f0b-9755-82b329060ffd None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.756222 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc8189-f032-4f0b-9755-82b329060ffd None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.756505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc8189-f032-4f0b-9755-82b329060ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.774998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f9dc8189-f032-4f0b-9755-82b329060ffd None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:08.776292 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9dc8189-f032-4f0b-9755-82b329060ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:08.835582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1399/2797] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:32:08.847061 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:08.848996 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:08.909874 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8e3f-9928-46bb-9ed9-456b3d842e60 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:08.916872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:08.917905 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:08.918306 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:08.918717 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:08.933726 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:08.935238 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:08.945472 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1399/2798] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:12.897722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:12.898275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:12.898275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:12.925104 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] MFA Rules not processed for user `08f2f94c57ce4d2a907db09a7e1398b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:12.926392 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:12.994906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1400/2799] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:12 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:12.999478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:13.009347 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0cabf-e4d0-4203-a281-21e709a35687 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:13.014647 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:13.015384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:13.015728 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:13.016152 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] PATH_INFO: `/v3/projects` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:13.016860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:13.018815 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:13.052219 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1400/2800] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:12 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:13.056397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:13.072942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276d6e-e04b-4e2d-bf7a-6ff71b45d7f2 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:13.136248 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:13.136919 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:13.137206 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:13.137483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] PATH_INFO: `/v3/users` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:13.138238 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:13.140242 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:13.165195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1401/2801] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:13 2021] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:13.170930 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:13.186983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dce01-cd3d-4167-aec3-bb401cd78673 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:13.192619 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:13.193513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:13.193798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:13.194267 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:13.195058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:13.196690 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:13.212004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1401/2802] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:13.216845 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:13.230602 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb26c0-6606-4338-88d4-848477d4f78d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:13.235448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:13.236347 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:13.236630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:13.236925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] PATH_INFO: `/v3/projects/b5aaebc835af419d934d8f754eee3935/users/852fbf5a839f42bb90540cb493099959/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:13.255911 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5aaebc835af419d934d8f754eee3935, user_id=852fbf5a839f42bb90540cb493099959, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:13.258675 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:13.276381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1402/2803] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:13 2021] PUT /identity/v3/projects/b5aaebc835af419d934d8f754eee3935/users/852fbf5a839f42bb90540cb493099959/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:13.280370 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:13.298407 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24ff87-5fd4-409c-852c-678d178b715c admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:13.372831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661f0a9-b156-49c6-939d-df2ff8e78347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:13.373517 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f0a9-b156-49c6-939d-df2ff8e78347 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:13.373998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f0a9-b156-49c6-939d-df2ff8e78347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:13.374521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f0a9-b156-49c6-939d-df2ff8e78347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:13.375503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661f0a9-b156-49c6-939d-df2ff8e78347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:13.377450 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661f0a9-b156-49c6-939d-df2ff8e78347 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:13.390651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1402/2804] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:13 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:13.396733 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:13.409054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a080c0-04d5-43c3-8eff-91e48fec7df6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:13.415849 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:13.416883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:13.417734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:13.418308 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] PATH_INFO: `/v3/projects/b5aaebc835af419d934d8f754eee3935/users/852fbf5a839f42bb90540cb493099959/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:13.427004 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5aaebc835af419d934d8f754eee3935, user_id=852fbf5a839f42bb90540cb493099959, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:13.430617 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:13.444343 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1403/2805] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:13 2021] PUT /identity/v3/projects/b5aaebc835af419d934d8f754eee3935/users/852fbf5a839f42bb90540cb493099959/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:18.350642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:18.350642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:18.351491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:18.394605 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] MFA Rules not processed for user `852fbf5a839f42bb90540cb493099959`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:18.397902 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:18.492244 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1403/2806] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:18 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:18.506115 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:18.511607 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:18.647640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150d7c-65f4-40a0-a7b8-0875d7a77191 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:18.657220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:18.657883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:18.658201 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:18.658425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:18.722942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:18.725577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:18.736450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1404/2807] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:18 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:20.556533 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:20.558254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:20.626912 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5d92-ba44-4ce9-9429-03f682bc0bc7 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:20.631499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:20.632410 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:20.632684 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:20.633004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] PATH_INFO: `/v3/users/afeb589535f44eb598f77ea6b3b9bb64` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:20.634217 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afeb589535f44eb598f77ea6b3b9bb64)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:20.636491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:20.693116 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afeb589535f44eb598f77ea6b3b9bb64'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:20.693862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afeb589535f44eb598f77ea6b3b9bb64'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:20.694537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afeb589535f44eb598f77ea6b3b9bb64'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:20.703674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afeb589535f44eb598f77ea6b3b9bb64'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:20.716752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afeb589535f44eb598f77ea6b3b9bb64'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:20.730721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1404/2808] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:20 2021] DELETE /identity/v3/users/afeb589535f44eb598f77ea6b3b9bb64 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:20.913492 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:20.926019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc654-0baf-4c88-95e7-601c91d65d09 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:20.999093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:21.000203 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.000572 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.000857 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] PATH_INFO: `/v3/projects/2ca8925c1c7049debac2355a4425e885` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.002342 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca8925c1c7049debac2355a4425e885)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:21.004689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:21.059703 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca8925c1c7049debac2355a4425e885', 'request_id': 'req-2136249a-01be-4b88-a74c-8b503ced6d05'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.069349 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca8925c1c7049debac2355a4425e885', 'request_id': 'req-2136249a-01be-4b88-a74c-8b503ced6d05'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.076268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca8925c1c7049debac2355a4425e885', 'request_id': 'req-2136249a-01be-4b88-a74c-8b503ced6d05'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.095680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] The token cache is being invalidate because project 2ca8925c1c7049debac2355a4425e885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:21.096061 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.097313 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.099524 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1405/2809] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:20 2021] DELETE /identity/v3/projects/2ca8925c1c7049debac2355a4425e885 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:21.103814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:21.105778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:21.119672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070fef-1e7f-443e-b403-8b4b455c4122 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:21.191038 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:21.191818 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.192122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.192371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] PATH_INFO: `/v3/users/54dc376d2bdd4c759e4e6b454723ea26` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.193719 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=54dc376d2bdd4c759e4e6b454723ea26)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:21.195834 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:21.251465 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54dc376d2bdd4c759e4e6b454723ea26'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.252233 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54dc376d2bdd4c759e4e6b454723ea26'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.252889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54dc376d2bdd4c759e4e6b454723ea26'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.268977 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54dc376d2bdd4c759e4e6b454723ea26'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.283952 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-315b0cad-1c47-4326-8c52-6256659eb1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54dc376d2bdd4c759e4e6b454723ea26'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.297173 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1405/2810] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:21 2021] DELETE /identity/v3/users/54dc376d2bdd4c759e4e6b454723ea26 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:21.478976 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:21.480795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:21.496935 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136249a-01be-4b88-a74c-8b503ced6d05 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:21.573210 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:21.574098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.576388 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.576910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] PATH_INFO: `/v3/projects/a4739349815d48c8b7953c5e26e4bd75` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.578252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4739349815d48c8b7953c5e26e4bd75)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:21.580147 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:21.641487 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4739349815d48c8b7953c5e26e4bd75', 'request_id': 'req-a8d6b13f-3adb-4b4a-9313-6601254039ee'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.651729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4739349815d48c8b7953c5e26e4bd75', 'request_id': 'req-a8d6b13f-3adb-4b4a-9313-6601254039ee'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.663042 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4739349815d48c8b7953c5e26e4bd75', 'request_id': 'req-a8d6b13f-3adb-4b4a-9313-6601254039ee'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.678817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] The token cache is being invalidate because project a4739349815d48c8b7953c5e26e4bd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:21.679425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.680594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-a8d6b13f-3adb-4b4a-9313-6601254039ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:21.687741 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1406/2811] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:21 2021] DELETE /identity/v3/projects/a4739349815d48c8b7953c5e26e4bd75 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:21.689295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.689752 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.689849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.710692 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:21.712434 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:21.782051 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1406/2812] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:21.790749 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.791213 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.791425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.814714 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:21.816394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:21.830483 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1407/2813] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:32:21.832405 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:21.842867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eb72-1f2d-4fba-9fa2-bd684431e13f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:21.853122 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:21.853811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.854089 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.854998 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.855935 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:32:21.856709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:21.858436 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:21.872549 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1407/2814] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:32:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:32:21.877023 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:21.888846 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b5c8e-d686-49bb-9e18-fade55a9db01 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:21.894450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:21.895261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:21.895543 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:21.895994 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:21.896821 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:21.899085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:21.926406 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1408/2815] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:21 2021] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:32:21.930696 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:21.943609 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d4f7-7c8c-46af-9244-6a916c6ea753 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:22.007001 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:22.007627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:22.007805 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:22.008230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:22.008959 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:22.011095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:22.039808 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1408/2816] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:21 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:32:22.044582 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:22.058215 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5db8-a037-4152-a62d-339903d31437 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:22.064032 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:22.064929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:22.065450 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:22.065970 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:22.066830 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:22.068681 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:22.083906 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1409/2817] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:22 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 10 16:32:22.085208 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:22.096359 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f202-7908-46da-90dd-f15dcab11126 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:22.102751 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51b40-2c58-42ab-9bb5-6590f9475640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:22.103458 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51b40-2c58-42ab-9bb5-6590f9475640 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:22.103895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51b40-2c58-42ab-9bb5-6590f9475640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:22.104211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51b40-2c58-42ab-9bb5-6590f9475640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:22.105057 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa51b40-2c58-42ab-9bb5-6590f9475640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:22.107314 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa51b40-2c58-42ab-9bb5-6590f9475640 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:22.123535 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1409/2818] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:22 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:22.127294 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:22.138712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7dcf2-5c4e-4150-9544-5bab3581f5eb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:22.143415 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:22.144425 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:22.144869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:22.145618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] PATH_INFO: `/v3/projects/19f59035df7a4a5d94db745c00dc755a/users/f2a1547ecb8d48d78c37199d91b9268e/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:22.164629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f59035df7a4a5d94db745c00dc755a, user_id=f2a1547ecb8d48d78c37199d91b9268e, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:22.167903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:22.208734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:22.208924 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:22.209211 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:22.221336 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1410/2819] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:22 2021] PUT /identity/v3/projects/19f59035df7a4a5d94db745c00dc755a/users/f2a1547ecb8d48d78c37199d91b9268e/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:22.260926 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] MFA Rules not processed for user `f2a1547ecb8d48d78c37199d91b9268e`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:22.262092 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:22.373162 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1410/2820] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:22.382545 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:22.384247 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:22.463430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c16a3-2232-4972-9e92-ea5bb5b50627 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:22.467501 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f4924-9722-4442-95b9-e4f60f471829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:22.468170 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f4924-9722-4442-95b9-e4f60f471829 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:22.468461 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f4924-9722-4442-95b9-e4f60f471829 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:22.468727 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f4924-9722-4442-95b9-e4f60f471829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:22.478630 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f4924-9722-4442-95b9-e4f60f471829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:22.480233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f4924-9722-4442-95b9-e4f60f471829 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:22.490761 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1411/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:22 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:31.008475 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:31.100231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea8265-fc9b-4daa-8468-df6ac37fd47a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:31.105341 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:31.106231 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.106504 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.106777 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] PATH_INFO: `/v3/users/f2a1547ecb8d48d78c37199d91b9268e` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.108015 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a1547ecb8d48d78c37199d91b9268e)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:31.109987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:31.171283 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a1547ecb8d48d78c37199d91b9268e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.171942 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a1547ecb8d48d78c37199d91b9268e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.172529 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a1547ecb8d48d78c37199d91b9268e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.181287 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a1547ecb8d48d78c37199d91b9268e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.195889 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a1547ecb8d48d78c37199d91b9268e'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.210199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1411/2822] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:31 2021] DELETE /identity/v3/users/f2a1547ecb8d48d78c37199d91b9268e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:31.215105 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.215635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.215635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.236778 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:31.238233 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:31.304635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1412/2823] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:31.314908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:31.316600 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:31.381327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dda70-a003-469a-8a59-f214c3a5c9b8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:31.385212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d4b1-9421-4a01-8b95-e91b3adc7664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:31.385885 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d4b1-9421-4a01-8b95-e91b3adc7664 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.386184 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d4b1-9421-4a01-8b95-e91b3adc7664 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.386478 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d4b1-9421-4a01-8b95-e91b3adc7664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.395811 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d4b1-9421-4a01-8b95-e91b3adc7664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:31.397248 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d4b1-9421-4a01-8b95-e91b3adc7664 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:31.407230 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1412/2824] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:31.681364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:31.682891 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:31.697216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546af93-7840-4b6c-acbe-b75fe98306a5 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:31.702144 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:31.703471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.703748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.704022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] PATH_INFO: `/v3/projects/19f59035df7a4a5d94db745c00dc755a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.705255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f59035df7a4a5d94db745c00dc755a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:31.707279 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:31.757096 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f59035df7a4a5d94db745c00dc755a', 'request_id': 'req-749bec13-1f72-4473-bcd9-10e1bddd4f71'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.766991 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f59035df7a4a5d94db745c00dc755a', 'request_id': 'req-749bec13-1f72-4473-bcd9-10e1bddd4f71'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.772825 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f59035df7a4a5d94db745c00dc755a', 'request_id': 'req-749bec13-1f72-4473-bcd9-10e1bddd4f71'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.783868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] The token cache is being invalidate because project 19f59035df7a4a5d94db745c00dc755a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:31.784161 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.785029 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-749bec13-1f72-4473-bcd9-10e1bddd4f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:31.786667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1413/2825] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:31 2021] DELETE /identity/v3/projects/19f59035df7a4a5d94db745c00dc755a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:31.793236 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.793523 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.793797 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.811850 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:31.813037 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:31.881527 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1413/2826] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:31.933795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.934065 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.934369 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.953867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:31.955132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:31.967955 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1414/2827] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:31.972617 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:31.982867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7aa8-940c-4d13-88b6-a66181a9523a None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:31.989543 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:31.990193 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:31.990508 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:31.990778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:31.991522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:32:31.991831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:31.993426 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.005857 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1414/2828] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:32:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:32:32.010663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:32.020327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702717f-3d83-46dc-a10d-d65d5f22c260 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:32.028302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:32.029441 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.029887 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.030335 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.031550 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:32.034771 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.070516 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1415/2829] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:32 2021] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:32.074979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:32.086367 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0d0a-7869-4736-8313-922c19be1a1b admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:32.146914 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:32.155124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.155124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.155124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.155124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:32.155124 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.175154 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1415/2830] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:32 2021] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:32.180430 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:32.191467 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e4c10-4001-4024-8bec-fac7492adf1d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:32.196518 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:32.197214 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.197494 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.197769 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.198544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:32.200181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.211041 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1416/2831] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:32.215559 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:32.230254 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee761b-632d-44a6-95e8-1633a9129364 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:32.237643 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc86b-b18f-454b-abf0-5e34ca88d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:32.238720 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc86b-b18f-454b-abf0-5e34ca88d5bb admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.239353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc86b-b18f-454b-abf0-5e34ca88d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.239634 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc86b-b18f-454b-abf0-5e34ca88d5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.240391 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc86b-b18f-454b-abf0-5e34ca88d5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:32.242004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc86b-b18f-454b-abf0-5e34ca88d5bb admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.252531 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1416/2832] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:32 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:32.258275 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:32.268807 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511837-b270-4dd2-9ffe-c949e2c1520d admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:32.275005 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:32.275729 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.276013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.276290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] PATH_INFO: `/v3/projects/11023f555217450fad3a259aa466ac2a/users/cd728d943ed54106a834500ee9d02b86/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.291739 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11023f555217450fad3a259aa466ac2a, user_id=cd728d943ed54106a834500ee9d02b86, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:32.294488 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.311498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1417/2833] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:32 2021] PUT /identity/v3/projects/11023f555217450fad3a259aa466ac2a/users/cd728d943ed54106a834500ee9d02b86/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:32.322055 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.322371 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.322651 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.349748 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] MFA Rules not processed for user `cd728d943ed54106a834500ee9d02b86`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:32.351021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:32.422025 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1417/2834] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:32.433148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:32.434981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:32.497690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37948a-e0c3-4429-b5b0-9237c30fde4a admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:32.502677 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095410af-3746-4ac6-a69a-ec20cdffbc75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:32.503327 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095410af-3746-4ac6-a69a-ec20cdffbc75 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:32.503648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095410af-3746-4ac6-a69a-ec20cdffbc75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:32.503927 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095410af-3746-4ac6-a69a-ec20cdffbc75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:32.513071 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095410af-3746-4ac6-a69a-ec20cdffbc75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:32.514496 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095410af-3746-4ac6-a69a-ec20cdffbc75 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:32.523820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1418/2835] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:32 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:35.099145 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:35.177384 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777765-1e0a-41a4-8ed7-a05ceffe5ca3 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:35.183159 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:35.184065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:35.184355 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:35.184630 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] PATH_INFO: `/v3/users/cd728d943ed54106a834500ee9d02b86` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:35.185896 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd728d943ed54106a834500ee9d02b86)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:35.187893 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:35.253858 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd728d943ed54106a834500ee9d02b86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.254589 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd728d943ed54106a834500ee9d02b86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.255239 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd728d943ed54106a834500ee9d02b86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.265270 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd728d943ed54106a834500ee9d02b86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.276974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd728d943ed54106a834500ee9d02b86'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.289479 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1418/2836] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:32:35 2021] DELETE /identity/v3/users/cd728d943ed54106a834500ee9d02b86 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:35.295755 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:35.296239 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:35.296363 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:35.315474 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:35.316692 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:35.384735 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1419/2837] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:35.394974 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:35.400059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:35.468004 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2a124-2195-47ea-b3d8-7559aebb2c8d admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:35.471713 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4b55d-6b53-4c19-813e-2ca44d53bb11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:35.472353 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4b55d-6b53-4c19-813e-2ca44d53bb11 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:35.472629 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4b55d-6b53-4c19-813e-2ca44d53bb11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:35.472908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4b55d-6b53-4c19-813e-2ca44d53bb11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:35.482272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4b55d-6b53-4c19-813e-2ca44d53bb11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:35.483721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4b55d-6b53-4c19-813e-2ca44d53bb11 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:35.494801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1419/2838] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:35.767407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:35.768926 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:35.782638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5dab-ed13-4ca6-ac47-c7431df89f09 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:35.787565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:35.788587 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:35.790966 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:35.791277 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] PATH_INFO: `/v3/projects/11023f555217450fad3a259aa466ac2a` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:35.792609 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11023f555217450fad3a259aa466ac2a)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:35.795085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:35.849621 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11023f555217450fad3a259aa466ac2a', 'request_id': 'req-b684e4d5-33fc-49cc-b508-22b14739db84'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.859531 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11023f555217450fad3a259aa466ac2a', 'request_id': 'req-b684e4d5-33fc-49cc-b508-22b14739db84'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.865701 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11023f555217450fad3a259aa466ac2a', 'request_id': 'req-b684e4d5-33fc-49cc-b508-22b14739db84'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.877578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] The token cache is being invalidate because project 11023f555217450fad3a259aa466ac2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:32:35.877860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.878523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-b684e4d5-33fc-49cc-b508-22b14739db84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:32:35.880191 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1420/2839] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:32:35 2021] DELETE /identity/v3/projects/11023f555217450fad3a259aa466ac2a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:35.886118 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:35.886445 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:35.886721 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:35.905851 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:35.907005 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:35.968455 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1420/2840] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:32:35.977544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:35.977855 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:35.978216 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.000457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:36.001690 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:36.011302 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1421/2841] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:36.015918 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.027068 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffcd1c-c6cd-4d03-9829-8a175f00bf71 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.033106 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.033774 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.034049 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.034349 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.035104 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:32:36.035408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.037050 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.050502 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1421/2842] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:32:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:32:36.055473 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.065145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fdd43-75b6-42ce-ba7b-b62bfb6cb000 None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.071185 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.071847 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.072119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.072397 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.073099 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.075134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.107002 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1422/2843] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:36 2021] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:36.111803 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.123385 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6ebbe-861e-408c-988d-dd16724ef0e6 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.185272 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.185862 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.186143 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.186449 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.187210 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.189155 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.211199 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1422/2844] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:36 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:36.215642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.226404 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584b21-75f2-4eb2-9772-9836a07cbfaa admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.231435 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.232098 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.232382 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.232658 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.233410 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.235085 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.247934 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1423/2845] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:36.253043 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.264969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9f415-7007-44d5-a93a-2707447232c0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.270298 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678247f-7604-4685-9ccb-128be3cb7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.270969 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678247f-7604-4685-9ccb-128be3cb7933 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.271252 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678247f-7604-4685-9ccb-128be3cb7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.271507 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678247f-7604-4685-9ccb-128be3cb7933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.272295 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678247f-7604-4685-9ccb-128be3cb7933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.273903 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678247f-7604-4685-9ccb-128be3cb7933 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.284408 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1423/2846] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:36.289691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.303358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75cb11-1711-4889-8e7e-c292519c12f7 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.309707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.310660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.310945 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.311224 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] PATH_INFO: `/v3/projects/ad5f5b685739474d8b7d172780b85bcc/users/29ec7c375fa5465f867ec8f46c7dc484/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.326752 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5f5b685739474d8b7d172780b85bcc, user_id=29ec7c375fa5465f867ec8f46c7dc484, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.329532 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.345833 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1424/2847] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:36 2021] PUT /identity/v3/projects/ad5f5b685739474d8b7d172780b85bcc/users/29ec7c375fa5465f867ec8f46c7dc484/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:36.351262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0ffe-ea32-49c0-b880-635e35d841fc None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.351554 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0ffe-ea32-49c0-b880-635e35d841fc None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.351832 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0ffe-ea32-49c0-b880-635e35d841fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.370460 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-1b1d0ffe-ea32-49c0-b880-635e35d841fc None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:36.371655 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-1b1d0ffe-ea32-49c0-b880-635e35d841fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:36.433552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1424/2848] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:36.443742 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:36.445520 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:36.504691 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dd549-e6bb-4564-9e0d-e7e1bc8622fb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:36.508451 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:36.509130 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:36.509407 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:36.509674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:36.519126 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:36.520707 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:36.530719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1425/2849] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:39.729611 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603863-e5dc-4875-a6e7-0d59fc439471 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:39.731826 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603863-e5dc-4875-a6e7-0d59fc439471 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:39.732201 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603863-e5dc-4875-a6e7-0d59fc439471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:39.755512 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9a603863-e5dc-4875-a6e7-0d59fc439471 None None] MFA Rules not processed for user `08f2f94c57ce4d2a907db09a7e1398b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:39.757095 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9a603863-e5dc-4875-a6e7-0d59fc439471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:39.836420 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1425/2850] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:39.874148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:39.875751 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:39.976558 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093adc0e-1c24-4df5-a332-3492aaed3c38 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:39.980390 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f74dc52500784e41bce60a945035ab74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:39.981232 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:39.981523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:39.981802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:39.983647 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:40.063195 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:40.064940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:40.077348 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1426/2851] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:40.561222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:40.561778 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:40.562059 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:40.593012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] MFA Rules not processed for user `29ec7c375fa5465f867ec8f46c7dc484`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:40.594665 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:40.668065 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1426/2852] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:40 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:40.669493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:40.681053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0064b9-2288-449a-9978-9258a0cdf245 service cinder] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:40.687252 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:40.688054 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:40.688434 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:40.688812 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:40.689689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:40.692498 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:40.725660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1427/2853] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:32:40 2021] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:40.727013 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:40.739970 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c1c0-417a-4a1d-b910-bbdf000d1c44 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:40.805838 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:40.806572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:40.806854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:40.807132 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:40.807860 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:40.809979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:40.832398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1427/2854] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:32:40 2021] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:32:40.836737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:40.848205 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb268-65b6-42e1-8303-e47b231bf378 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:40.854913 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:40.855367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:40.855795 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:40.856083 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:40.856843 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:40.858552 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:40.872151 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1428/2855] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:40.876849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:40.888212 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bce38-5799-41fb-a898-ea78bf5eeab8 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:40.894054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:40.895293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:40.895813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:40.896097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] PATH_INFO: `/v3/projects/c6101c666a7843018f860d5aab0c3ac2/users/514c0336f4f94a69bc9b4167365536b7/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:40.917097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6101c666a7843018f860d5aab0c3ac2, user_id=514c0336f4f94a69bc9b4167365536b7, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:40.924566 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:40.947831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1428/2856] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:40 2021] PUT /identity/v3/projects/c6101c666a7843018f860d5aab0c3ac2/users/514c0336f4f94a69bc9b4167365536b7/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:40.952152 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:40.963419 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4a98c-9f61-4d93-a1a7-1fe98b17d9a9 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:41.025848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:41.026722 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:41.027006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:41.027280 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:41.028046 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:41.029759 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:41.041458 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1429/2857] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:32:41.045798 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:41.056992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59e1d-bc70-46ff-bcce-979fc9f51dd7 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:41.061620 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:41.062561 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:41.062864 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:41.063168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] PATH_INFO: `/v3/projects/c6101c666a7843018f860d5aab0c3ac2/users/514c0336f4f94a69bc9b4167365536b7/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:41.065486 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6101c666a7843018f860d5aab0c3ac2, user_id=514c0336f4f94a69bc9b4167365536b7, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:41.068242 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:41.079499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1429/2858] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:32:41 2021] PUT /identity/v3/projects/c6101c666a7843018f860d5aab0c3ac2/users/514c0336f4f94a69bc9b4167365536b7/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:32:41.985747 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:42.076429 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c4e61-22de-4eeb-aaa6-c0b9f90ba98e admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:42.142802 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:42.143603 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:42.144053 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:42.144493 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:42.146708 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:42.250579 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:42.252089 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54315bf0-fa06-450b-b5cb-f895a0c9368f service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:42.272387 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1430/2859] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:44.415551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:44.418572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:44.442916 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948082e-4949-4fc8-8284-10684ea594a0 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:44.462627 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:44.463377 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:44.465222 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:44.465522 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:44.470652 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:44.500070 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:44.502146 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:44.523716 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1430/2860] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:46.729674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce7dd-e8ff-40e0-b525-b41dfcb41bc1 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:46.730610 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce7dd-e8ff-40e0-b525-b41dfcb41bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:46.730890 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce7dd-e8ff-40e0-b525-b41dfcb41bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:46.759859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-9e9ce7dd-e8ff-40e0-b525-b41dfcb41bc1 None None] MFA Rules not processed for user `514c0336f4f94a69bc9b4167365536b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:46.761674 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-9e9ce7dd-e8ff-40e0-b525-b41dfcb41bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:46.833533 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1431/2861] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:46 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:46.847557 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:46.848983 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:46.914403 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cf22c-bcfa-4c61-a3c3-355604fcfde7 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:46.918077 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06999fb0772947f584d5608ca26f9352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:46.918773 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:46.919052 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:46.919331 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:46.976849 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:46.978578 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:46.987978 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1431/2862] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:46 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:47.103584 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163a71-e115-4627-9b04-21fb99b1fc6d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:47.103940 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163a71-e115-4627-9b04-21fb99b1fc6d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:47.104285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163a71-e115-4627-9b04-21fb99b1fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:47.171564 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-51163a71-e115-4627-9b04-21fb99b1fc6d None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:47.172777 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-51163a71-e115-4627-9b04-21fb99b1fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:47.238148 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1432/2863] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 16:32:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:47.312992 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:47.316090 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:47.415641 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c735b5-c2c3-41f5-a17e-50cc26739305 service glance] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:47.421470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:47.422319 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:47.422806 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:47.423241 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:47.432809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:47.434585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:47.444313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1432/2864] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 16:32:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 16:32:56.649383 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2baeb6e-b840-4ee8-988d-11e85f9d9b28 None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:56.650056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2baeb6e-b840-4ee8-988d-11e85f9d9b28 None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:56.650056 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2baeb6e-b840-4ee8-988d-11e85f9d9b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:56.669432 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-b2baeb6e-b840-4ee8-988d-11e85f9d9b28 None None] MFA Rules not processed for user `29ec7c375fa5465f867ec8f46c7dc484`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:56.670678 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-b2baeb6e-b840-4ee8-988d-11e85f9d9b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:56.678132 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1433/2865] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:32:56 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:32:57.445580 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:57.455012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58467e-a838-4841-8700-29829eae9a29 service swift] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:57.458622 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:57.459256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:57.459663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:57.459982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:57.461855 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:57.527456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:57.529067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:57.540457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1433/2866] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:32:57 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:32:58.493220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:58.493220 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:58.493851 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:58.515463 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:32:58.516608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:32:58.524954 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1434/2867] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Nov 10 16:32:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 10 16:32:58.538750 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:32:58.552027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dced3-3ec7-4358-84bb-9e2803f42fbc service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:32:58.557169 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:32:58.557956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:32:58.558340 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:32:58.558804 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:32:58.568234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:32:58.570262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:32:58.579833 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1434/2868] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 16:32:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 16:33:24.562868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:33:24.573605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3cec6-c5db-4718-a512-602d699e555d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:33:24.578513 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:33:24.579296 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:33:24.579530 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:33:24.579804 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:33:24.590093 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:33:24.591646 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:33:24.601834 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1435/2869] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:33:24 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:34:19.335075 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:19.337207 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:19.421361 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46703e-e3dd-40b6-8f5f-51c4b8dbe199 service swift] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:19.427170 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:19.427817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:19.428099 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:19.428375 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:19.430394 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:19.442282 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:19.443854 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8cc4e-b5fa-41de-986a-6c7fe816b612 service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:19.453984 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1435/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:34:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:34:35.935639 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:35.936774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:35.962137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f30eb-2426-46a9-86bc-301374ef56a7 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:35.972744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:35.977178 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:35.977526 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:35.977972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:35.980359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:36.003117 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:36.005290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:36.030396 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1436/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:34:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:34:43.304792 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:43.305261 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:43.305343 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:43.323794 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] MFA Rules not processed for user `c57ea6e1a68f45e98ebaf2804cde1337`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:34:43.324986 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:43.333274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1436/2872] 10.222.0.60 () {58 vars in 967 bytes} [Wed Nov 10 16:34:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:34:43.374923 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:43.386858 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806873-8b63-45ab-a052-1c0c46442c6a service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:43.393113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025c8b235c244612932e1c931b40cf35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:43.393839 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:43.394293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:43.394696 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:43.403634 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:43.405309 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:43.414190 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1437/2873] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Nov 10 16:34:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 10 16:34:50.436432 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:50.504404 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45ff2e-6614-4a53-8c3d-06d89660742f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:50.510781 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:50.512110 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:50.512503 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:50.512867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] PATH_INFO: `/v3/users/29ec7c375fa5465f867ec8f46c7dc484` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:50.514608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ec7c375fa5465f867ec8f46c7dc484)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:50.517156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:50.568793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ec7c375fa5465f867ec8f46c7dc484'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.569352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ec7c375fa5465f867ec8f46c7dc484'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.569944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ec7c375fa5465f867ec8f46c7dc484'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.579080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ec7c375fa5465f867ec8f46c7dc484'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.590606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ec7c375fa5465f867ec8f46c7dc484'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.602962 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1437/2874] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:34:50 2021] DELETE /identity/v3/users/29ec7c375fa5465f867ec8f46c7dc484 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:34:50.793268 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:50.806746 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a97d-3ff0-4958-9e1e-e2adf2c60889 service swift] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:50.865255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:50.866301 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:50.866594 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:50.866872 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] PATH_INFO: `/v3/projects/ad5f5b685739474d8b7d172780b85bcc` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:50.868500 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5f5b685739474d8b7d172780b85bcc)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:50.870502 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:50.918864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5f5b685739474d8b7d172780b85bcc', 'request_id': 'req-89fe395f-0122-40a7-ad22-0ec5009d79ba'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.928869 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5f5b685739474d8b7d172780b85bcc', 'request_id': 'req-89fe395f-0122-40a7-ad22-0ec5009d79ba'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.934720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5f5b685739474d8b7d172780b85bcc', 'request_id': 'req-89fe395f-0122-40a7-ad22-0ec5009d79ba'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.946290 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] The token cache is being invalidate because project ad5f5b685739474d8b7d172780b85bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:34:50.946577 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.947253 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:50.948861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1438/2875] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:34:50 2021] DELETE /identity/v3/projects/ad5f5b685739474d8b7d172780b85bcc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:34:50.953097 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:50.954585 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:50.967915 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a9bc-3243-42aa-85c2-bf0874226646 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.031603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.032879 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.033246 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.033636 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] PATH_INFO: `/v3/users/514c0336f4f94a69bc9b4167365536b7` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.035663 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=514c0336f4f94a69bc9b4167365536b7)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.037513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.095821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514c0336f4f94a69bc9b4167365536b7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.096572 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514c0336f4f94a69bc9b4167365536b7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.097280 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514c0336f4f94a69bc9b4167365536b7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.106129 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514c0336f4f94a69bc9b4167365536b7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.119020 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-3376171a-3459-4227-8b2b-90d0e9c37d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514c0336f4f94a69bc9b4167365536b7'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.131250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1438/2876] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:34:50 2021] DELETE /identity/v3/users/514c0336f4f94a69bc9b4167365536b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:34:51.305136 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.306930 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:51.323125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe395f-0122-40a7-ad22-0ec5009d79ba admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.381924 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.382842 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.383160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.383437 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] PATH_INFO: `/v3/projects/c6101c666a7843018f860d5aab0c3ac2` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.384638 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6101c666a7843018f860d5aab0c3ac2)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.386566 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.438959 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6101c666a7843018f860d5aab0c3ac2', 'request_id': 'req-09186da1-2930-4d55-9aa7-40113cef5994'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.447883 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6101c666a7843018f860d5aab0c3ac2', 'request_id': 'req-09186da1-2930-4d55-9aa7-40113cef5994'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.454025 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6101c666a7843018f860d5aab0c3ac2', 'request_id': 'req-09186da1-2930-4d55-9aa7-40113cef5994'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.465817 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] The token cache is being invalidate because project c6101c666a7843018f860d5aab0c3ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:34:51.466255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.466909 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-09186da1-2930-4d55-9aa7-40113cef5994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:34:51.468578 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1439/2877] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:34:51 2021] DELETE /identity/v3/projects/c6101c666a7843018f860d5aab0c3ac2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:34:51.474788 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.475296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.475296 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.495666 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:34:51.496852 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:51.557028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1439/2878] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:34:51.565187 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.565475 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.565754 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.585013 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:34:51.586283 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:51.594929 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1440/2879] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:34:51.600213 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.616762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269efe9-e518-4bf0-acac-fcaa0933d66f None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.625398 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.626509 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.626937 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.627374 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] PATH_INFO: `/v3/domains` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.628532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 10 16:34:51.629016 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.630817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.643768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1440/2880] 10.222.0.60 () {58 vars in 1152 bytes} [Wed Nov 10 16:34:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 10 16:34:51.648595 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.661720 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ae26a-98bf-403a-bf93-b53a6644052d None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.667554 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.668228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.668514 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.668785 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.669597 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.671604 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.700003 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1441/2881] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:34:51 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:34:51.704424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.714943 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68d5e-4fa0-4f01-ab05-11644179cafa admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.772669 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.773327 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.773606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.773876 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.774603 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.776514 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.802799 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1441/2882] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:34:51 2021] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:34:51.808137 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.821968 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc365-e162-43b2-940b-0304700114eb admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.826963 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.827666 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.827941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.828209 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.828978 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.830648 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.841182 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1442/2883] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:34:51.845271 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.855791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdc044-6e4b-4545-bf25-b5a56ec6c776 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.861734 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1ad2-1eba-46ed-a649-33bb4412b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.862456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1ad2-1eba-46ed-a649-33bb4412b967 admin admin] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.862755 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1ad2-1eba-46ed-a649-33bb4412b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.863028 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1ad2-1eba-46ed-a649-33bb4412b967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.863831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1ad2-1eba-46ed-a649-33bb4412b967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.865471 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1ad2-1eba-46ed-a649-33bb4412b967 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.877842 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1442/2884] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:34:51.882271 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:51.892737 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adcc37-fc8e-4ea1-805d-896fd1b561bf admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:51.898972 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:51.899852 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.900125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.900400 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] PATH_INFO: `/v3/projects/5023a1b11c5d4cc2be900b25146d43d0/users/d9490a34b4f24bf7aaac71813e784fb1/roles/263e49b96efd4b2ca6397bef86f86309` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.915962 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5023a1b11c5d4cc2be900b25146d43d0, user_id=d9490a34b4f24bf7aaac71813e784fb1, role_id=263e49b96efd4b2ca6397bef86f86309)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:51.918768 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:51.936910 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1443/2885] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:34:51 2021] PUT /identity/v3/projects/5023a1b11c5d4cc2be900b25146d43d0/users/d9490a34b4f24bf7aaac71813e784fb1/roles/263e49b96efd4b2ca6397bef86f86309 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:34:51.942416 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c11359-1406-48f1-a421-4a25eca4e82f None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:51.942711 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c11359-1406-48f1-a421-4a25eca4e82f None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:51.942982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c11359-1406-48f1-a421-4a25eca4e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:51.961845 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-14c11359-1406-48f1-a421-4a25eca4e82f None None] MFA Rules not processed for user `0d0f0af1db944cb5ab99675a88ef9fef`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:34:51.963087 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-14c11359-1406-48f1-a421-4a25eca4e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:52.023229 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1443/2886] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:34:52.033362 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:52.035395 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:52.097180 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114169-e114-4a49-850b-fda368cd14f1 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:52.101485 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:52.102131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:52.102449 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:52.102723 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:52.113605 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:52.115204 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:52.125168 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1444/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:34:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:34:56.129575 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.130135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.130135 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.157592 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] MFA Rules not processed for user `d9490a34b4f24bf7aaac71813e784fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:34:56.158882 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:34:56.228209 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1444/2888] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:34:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:34:56.232784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:56.243836 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d0aa-6002-47e3-a0af-9832c2c4a9b6 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:56.250134 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:56.250867 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.251145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.251418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.252300 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:56.254941 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:56.298339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1445/2889] 10.222.0.60 () {60 vars in 1152 bytes} [Wed Nov 10 16:34:56 2021] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 10 16:34:56.302301 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:56.313844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f63ea-2dfc-400e-8db3-e0d7ea68e56c None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:56.378973 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:56.379741 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.380029 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.380312 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] PATH_INFO: `/v3/users` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.381085 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:56.383315 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:56.413791 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1445/2890] 10.222.0.60 () {60 vars in 1143 bytes} [Wed Nov 10 16:34:56 2021] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 10 16:34:56.417523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:56.432981 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ebe8-eb1f-496d-9ce3-9faa2dfa0df5 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:56.449743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:56.450744 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.451108 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.451471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.452339 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:56.454131 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:56.467060 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1446/2891] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:34:56.471704 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:56.492499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26c991-4e24-4422-8513-42bf30827653 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:56.503067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:56.504064 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.504490 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.504900 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] PATH_INFO: `/v3/projects/6445f18c72a04093bf9ff4bd779f0bd0/users/8bf53ca512e5413e8cfee725d334cec8/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.523344 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6445f18c72a04093bf9ff4bd779f0bd0, user_id=8bf53ca512e5413e8cfee725d334cec8, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:56.526139 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:56.544395 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1446/2892] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:34:56 2021] PUT /identity/v3/projects/6445f18c72a04093bf9ff4bd779f0bd0/users/8bf53ca512e5413e8cfee725d334cec8/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:34:56.548695 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:56.559212 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273290e4-be96-45f9-96fd-068ff6b2e90f admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:56.638687 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934321ad-3eee-4234-a992-4b78f617602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:56.639375 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934321ad-3eee-4234-a992-4b78f617602f admin admin] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.639663 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934321ad-3eee-4234-a992-4b78f617602f admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.639942 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934321ad-3eee-4234-a992-4b78f617602f admin admin] PATH_INFO: `/v3/roles` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.640925 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934321ad-3eee-4234-a992-4b78f617602f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:56.644006 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934321ad-3eee-4234-a992-4b78f617602f admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:56.654565 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1447/2893] 10.222.0.60 () {58 vars in 1121 bytes} [Wed Nov 10 16:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 10 16:34:56.658706 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:34:56.671285 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df147c8-bca8-4af3-be37-569b08f6116e admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:34:56.679334 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21b8a9-56e5-4621-af92-2782678afebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:34:56.680250 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b8a9-56e5-4621-af92-2782678afebd admin admin] REQUEST_METHOD: `PUT` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:34:56.680534 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b8a9-56e5-4621-af92-2782678afebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:34:56.680813 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b8a9-56e5-4621-af92-2782678afebd admin admin] PATH_INFO: `/v3/projects/6445f18c72a04093bf9ff4bd779f0bd0/users/8bf53ca512e5413e8cfee725d334cec8/roles/5e9f996724a24bb3aa705c50863a0224` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:34:56.682961 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21b8a9-56e5-4621-af92-2782678afebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6445f18c72a04093bf9ff4bd779f0bd0, user_id=8bf53ca512e5413e8cfee725d334cec8, role_id=5e9f996724a24bb3aa705c50863a0224)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:34:56.685712 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21b8a9-56e5-4621-af92-2782678afebd admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:34:56.697156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1447/2894] 10.222.0.60 () {60 vars in 1482 bytes} [Wed Nov 10 16:34:56 2021] PUT /identity/v3/projects/6445f18c72a04093bf9ff4bd779f0bd0/users/8bf53ca512e5413e8cfee725d334cec8/roles/5e9f996724a24bb3aa705c50863a0224 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:35:00.382019 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] REQUEST_METHOD: `POST` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:00.382608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:00.382608 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:00.458591 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.auth.core [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] MFA Rules not processed for user `08f2f94c57ce4d2a907db09a7e1398b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:35:00.460371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:00.603504 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1448/2895] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:35:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:35:02.288456 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb36093-6cfb-46ca-94c9-ba8d4a84b74b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:02.289021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb36093-6cfb-46ca-94c9-ba8d4a84b74b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:02.289021 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb36093-6cfb-46ca-94c9-ba8d4a84b74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:02.333606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-adb36093-6cfb-46ca-94c9-ba8d4a84b74b None None] MFA Rules not processed for user `8bf53ca512e5413e8cfee725d334cec8`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:35:02.334936 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-adb36093-6cfb-46ca-94c9-ba8d4a84b74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:02.446393 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1448/2896] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:35:02 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:35:02.469311 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:35:02.474090 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:02.601255 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded51b-5bf7-4f2e-a8c2-fda0f4e5b12c None None] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:35:02.607059 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:35:02.607743 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:02.608024 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:02.608304 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:02.675363 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:35:02.677618 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:35:02.687952 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1449/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:35:02 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:35:04.329499 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:04.330011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:04.330278 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:04.357257 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] MFA Rules not processed for user `d9490a34b4f24bf7aaac71813e784fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:35:04.358674 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:04.371785 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1449/2898] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:35:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:35:21.049622 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:35:21.051359 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:21.120537 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17605e42-cbfb-401e-9e1c-b52351b4c83b service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:35:21.124987 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:35:21.125635 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:21.125914 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:21.126199 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:21.128285 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:21.138794 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:35:21.140228 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:35:21.149113 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1450/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:35:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:35:21.624249 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:35:21.625867 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:21.701872 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cd79-371e-445f-8130-6dd91cacd449 None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:35:21.706887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:35:21.707530 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:21.707809 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:21.708080 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:21.709844 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:21.721676 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:35:21.723329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:35:21.733170 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1450/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:35:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:35:34.264881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:35:34.280784 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31e58b-1308-4aae-b09a-f45fc71ace0b service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:35:34.287529 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:35:34.288189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:34.288505 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:34.288774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:34.290953 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:34.304478 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:35:34.306124 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:35:34.317358 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1451/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:35:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:35:37.204762 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:35:37.215240 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28449ce-5b0f-4bcc-b0ac-7609b04ee39e service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:35:37.219887 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bdbfe-2de0-4f77-93a1-e23ce54cea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:35:37.220541 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bdbfe-2de0-4f77-93a1-e23ce54cea1b service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:37.220831 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bdbfe-2de0-4f77-93a1-e23ce54cea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:37.221103 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bdbfe-2de0-4f77-93a1-e23ce54cea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:37.231601 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bdbfe-2de0-4f77-93a1-e23ce54cea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:35:37.233054 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bdbfe-2de0-4f77-93a1-e23ce54cea1b service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:35:37.243709 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1451/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:35:37 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:35:39.242660 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:35:39.244868 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:39.259523 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50d72-3f71-4460-8325-49f0f1fc3fea service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:35:39.265760 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599ea3b3d1f5426ea3218ecb443ca0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:35:39.266447 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:35:39.266726 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:35:39.266973 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:35:39.268936 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:35:39.282119 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:35:39.283734 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:35:39.294490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1452/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:35:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:36:54.313328 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] REQUEST_METHOD: `POST` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:36:54.313910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:36:54.313910 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:36:54.333220 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.auth.core [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] MFA Rules not processed for user `08f2f94c57ce4d2a907db09a7e1398b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 10 16:36:54.334487 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:36:54.342895 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1452/2904] 10.222.0.60 () {58 vars in 957 bytes} [Wed Nov 10 16:36:54 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 10 16:36:54.692902 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:36:54.705040 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f65292-6e0a-484f-80c5-f5f6bcf57038 service nova] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:36:54.712145 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:36:54.713087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:36:54.713394 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:36:54.713750 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:36:54.716286 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:36:54.726619 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:36:54.727974 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:36:54.737700 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1453/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:36:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:37:41.872793 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:37:41.884168 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363480c9-53ca-4d7c-89c9-0f9276edb43b None None] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:37:41.888035 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:37:41.888672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:37:41.888946 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:37:41.889221 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:37:41.891031 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:37:41.906290 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:37:41.907768 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:37:41.919498 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1453/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:37:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:37:43.117860 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:37:43.132146 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae342c8-04d5-4d4b-9727-aede3d591522 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:37:43.137207 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:37:43.137881 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:37:43.138181 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:37:43.138471 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:37:43.140792 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:37:43.156217 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:37:43.157697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:37:43.169393 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1454/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:37:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:37:44.857944 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:37:44.867412 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb0b4-4be3-4ba9-8ce9-a5f3d9ba5277 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:37:44.872642 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:37:44.873491 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:37:44.873801 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:37:44.874140 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:37:44.877532 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:37:44.890646 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:37:44.892067 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:37:44.900552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1454/2908] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:37:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:37:48.223689 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:37:48.233125 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e12b22-e47d-4375-ae6c-c4abd349e884 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:37:48.236998 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:37:48.237626 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:37:48.237905 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:37:48.238189 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:37:48.240184 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:37:48.251000 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:37:48.252489 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:37:48.261399 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1455/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:37:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:38:39.945776 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:38:39.954982 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456080e-2ffe-49a2-ae14-74365d853142 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:38:39.958975 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:38:39.959608 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:38:39.959886 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:38:39.960164 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:38:39.962058 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:38:39.973084 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:38:39.974537 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:38:39.983817 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1455/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:38:39 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:38:53.426805 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:38:53.435773 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4541-1fc7-48ad-bc7b-d1563012a188 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:38:53.439513 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ecc2dca57d045869f1fcf3a4337b990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:38:53.440087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:38:53.440367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:38:53.440640 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:38:53.442713 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:38:53.535815 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:38:53.537293 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:38:53.557256 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1456/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:38:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:39:00.155365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:00.157727 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:00.177071 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7126f-8796-4827-a33e-5e159253ae08 service neutron] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:00.181760 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:00.182673 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:00.182956 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:00.183234 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] PATH_INFO: `/v3/users/08f2f94c57ce4d2a907db09a7e1398b4` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:00.184485 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f2f94c57ce4d2a907db09a7e1398b4)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:00.186519 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:00.243927 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f2f94c57ce4d2a907db09a7e1398b4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.244759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f2f94c57ce4d2a907db09a7e1398b4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.245457 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f2f94c57ce4d2a907db09a7e1398b4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.256345 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f2f94c57ce4d2a907db09a7e1398b4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.268354 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f2f94c57ce4d2a907db09a7e1398b4'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.280156 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1456/2912] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:39:00 2021] DELETE /identity/v3/users/08f2f94c57ce4d2a907db09a7e1398b4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:39:00.459101 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:00.470697 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479cbbc-88ef-4e39-82ac-84c6f6b7b130 service neutron] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:00.543118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:00.543985 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:00.544267 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:00.544548 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] PATH_INFO: `/v3/projects/cb1daf2d99b74460bbd97a9e0b7854fc` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:00.545748 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1daf2d99b74460bbd97a9e0b7854fc)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:00.547776 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:00.597022 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'request_id': 'req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.605716 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'request_id': 'req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.612045 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1daf2d99b74460bbd97a9e0b7854fc', 'request_id': 'req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.623389 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] The token cache is being invalidate because project cb1daf2d99b74460bbd97a9e0b7854fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:39:00.623680 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.624371 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.626074 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1457/2913] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:39:00 2021] DELETE /identity/v3/projects/cb1daf2d99b74460bbd97a9e0b7854fc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:39:00.630256 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:00.631672 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:00.645186 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaaa7c0-bcd3-4b82-943d-39c41c69a664 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:00.701552 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:00.702463 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:00.702739 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:00.703011 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] PATH_INFO: `/v3/users/852fbf5a839f42bb90540cb493099959` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:00.704293 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852fbf5a839f42bb90540cb493099959)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:00.706281 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:00.761816 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852fbf5a839f42bb90540cb493099959'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.762513 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852fbf5a839f42bb90540cb493099959'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.763206 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852fbf5a839f42bb90540cb493099959'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.775783 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852fbf5a839f42bb90540cb493099959'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.790558 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852fbf5a839f42bb90540cb493099959'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:00.802883 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1457/2914] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:39:00 2021] DELETE /identity/v3/users/852fbf5a839f42bb90540cb493099959 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:39:00.981636 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:00.983159 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:00.996457 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ef7b-06cb-43a2-ac8f-4969ff0f2e3c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:01.057642 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:01.058544 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:01.058820 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:01.059094 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] PATH_INFO: `/v3/projects/b5aaebc835af419d934d8f754eee3935` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:01.060333 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5aaebc835af419d934d8f754eee3935)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:01.062276 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:01.111629 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5aaebc835af419d934d8f754eee3935', 'request_id': 'req-47889d03-fbcf-424f-9a85-dd1293e76dd6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:01.120864 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5aaebc835af419d934d8f754eee3935', 'request_id': 'req-47889d03-fbcf-424f-9a85-dd1293e76dd6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:01.131100 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5aaebc835af419d934d8f754eee3935', 'request_id': 'req-47889d03-fbcf-424f-9a85-dd1293e76dd6'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:01.143160 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] The token cache is being invalidate because project b5aaebc835af419d934d8f754eee3935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:39:01.143442 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:01.144179 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:01.145835 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1458/2915] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:39:00 2021] DELETE /identity/v3/projects/b5aaebc835af419d934d8f754eee3935 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 10 16:39:21.301350 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:21.303190 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:21.451214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df6c1-1e7b-40bf-82a5-588b17452640 admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:21.515470 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:21.516253 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] REQUEST_METHOD: `GET` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:21.516521 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:21.516814 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:21.518821 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:21.531480 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:21.533137 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:21.545979 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1458/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:39:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 10 16:39:23.389149 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:23.391774 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:23.482330 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47889d03-fbcf-424f-9a85-dd1293e76dd6 admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:23.491712 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:23.493038 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:23.493448 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:23.493859 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] PATH_INFO: `/v3/users/d9490a34b4f24bf7aaac71813e784fb1` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:23.495848 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9490a34b4f24bf7aaac71813e784fb1)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:23.498798 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:23.549016 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9490a34b4f24bf7aaac71813e784fb1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.549682 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9490a34b4f24bf7aaac71813e784fb1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.550331 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9490a34b4f24bf7aaac71813e784fb1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.559861 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9490a34b4f24bf7aaac71813e784fb1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.572261 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9490a34b4f24bf7aaac71813e784fb1'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.585372 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1459/2917] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:39:23 2021] DELETE /identity/v3/users/d9490a34b4f24bf7aaac71813e784fb1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:39:23.760392 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:23.771759 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041b76-e06f-4042-b32b-5639fa5fdc2c service placement] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:23.828262 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:23.829313 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:23.829594 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:23.829870 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] PATH_INFO: `/v3/projects/5023a1b11c5d4cc2be900b25146d43d0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:23.831177 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5023a1b11c5d4cc2be900b25146d43d0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:23.833063 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:23.895338 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5023a1b11c5d4cc2be900b25146d43d0', 'request_id': 'req-b8ba3dfe-d007-4c70-a64d-181ce69984ea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.904683 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5023a1b11c5d4cc2be900b25146d43d0', 'request_id': 'req-b8ba3dfe-d007-4c70-a64d-181ce69984ea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.910908 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5023a1b11c5d4cc2be900b25146d43d0', 'request_id': 'req-b8ba3dfe-d007-4c70-a64d-181ce69984ea'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.922365 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] The token cache is being invalidate because project 5023a1b11c5d4cc2be900b25146d43d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:39:23.922659 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.923424 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:23.925027 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1459/2918] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:39:23 2021] DELETE /identity/v3/projects/5023a1b11c5d4cc2be900b25146d43d0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:39:23.929688 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:23.933064 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:23.950080 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24ddd4-7fcd-4844-8598-2c783e2f1fae admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:24.007585 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:24.008364 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:24.008637 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:24.008903 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] PATH_INFO: `/v3/users/8bf53ca512e5413e8cfee725d334cec8` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:24.010118 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf53ca512e5413e8cfee725d334cec8)` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:24.012139 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:24.062877 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf53ca512e5413e8cfee725d334cec8'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.063589 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf53ca512e5413e8cfee725d334cec8'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.064226 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf53ca512e5413e8cfee725d334cec8'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.072370 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf53ca512e5413e8cfee725d334cec8'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.084426 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.notifications [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf53ca512e5413e8cfee725d334cec8'} {{(pid=79127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.096377 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1460/2919] 10.222.0.60 () {58 vars in 1223 bytes} [Wed Nov 10 16:39:23 2021] DELETE /identity/v3/users/8bf53ca512e5413e8cfee725d334cec8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:39:24.274251 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Authenticating user token {{(pid=79128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:39:24.275836 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.fernet_utils [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:39:24.291026 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba3dfe-d007-4c70-a64d-181ce69984ea admin admin] Validating token access rules against request {{(pid=79128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:39:24.357138 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d0f0af1db944cb5ab99675a88ef9fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5257eb1aa0954376ba58fe4f7b901cea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:39:24.358012 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:39:24.358329 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:39:24.358606 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] PATH_INFO: `/v3/projects/6445f18c72a04093bf9ff4bd779f0bd0` {{(pid=79128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:39:24.359987 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6445f18c72a04093bf9ff4bd779f0bd0)` {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:39:24.362144 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] RBAC: Authorization granted {{(pid=79128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:39:24.416668 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6445f18c72a04093bf9ff4bd779f0bd0', 'request_id': 'req-516a3723-32dd-4ffc-8678-2fa59f37df59'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.429214 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6445f18c72a04093bf9ff4bd779f0bd0', 'request_id': 'req-516a3723-32dd-4ffc-8678-2fa59f37df59'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.435352 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6445f18c72a04093bf9ff4bd779f0bd0', 'request_id': 'req-516a3723-32dd-4ffc-8678-2fa59f37df59'} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.447266 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] The token cache is being invalidate because project 6445f18c72a04093bf9ff4bd779f0bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 10 16:39:24.447551 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.448274 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: DEBUG keystone.notifications [None req-516a3723-32dd-4ffc-8678-2fa59f37df59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 10 16:39:24.449925 dv-cinder-817085-2-iscsi devstack@keystone.service[79128]: [pid: 79128|app: 0|req: 1460/2920] 10.222.0.60 () {58 vars in 1232 bytes} [Wed Nov 10 16:39:24 2021] DELETE /identity/v3/projects/6445f18c72a04093bf9ff4bd779f0bd0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 10 16:44:24.324418 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Authenticating user token {{(pid=79127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 10 16:44:24.326087 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:44:24.411367 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407105-473b-4916-84ec-d3413871de1c admin admin] Validating token access rules against request {{(pid=79127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 10 16:44:24.483719 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e88500f303d44f67a828798654c72b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06f1ad84c65c41b38b6e138a457d1adc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 10 16:44:24.484385 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] REQUEST_METHOD: `GET` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 10 16:44:24.484667 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] SCRIPT_NAME: `/identity` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 10 16:44:24.484946 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 10 16:44:24.487381 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.fernet_utils [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 10 16:44:24.499892 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 10 16:44:24.501490 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a683-6128-429a-83ec-576dd7b2be04 service placement] RBAC: Authorization granted {{(pid=79127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 10 16:44:24.511850 dv-cinder-817085-2-iscsi devstack@keystone.service[79127]: [pid: 79127|app: 0|req: 1461/2921] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Nov 10 16:44:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)